Introduction to Kaunas Castle: Kaunas Castle was built in the 13th century. It is the earliest fortification in Lithuania and the only fortress protected by double walls. In 1362, the Crusaders invaded Kaunas and besieged the castle for three weeks before finally breaking through the defense and destroying the city wall.