In this area were found many traces of prehistoric man and it certainly was inhabited by the Volsci. During the Roman Republic in this area the three great battles against the Samnites took place and the city of Fregellae was built and then destroyed by the Romans in 125 BC. Pofi was the intersection of the important Via Latina (today via Casilina) linking Rome with Capua and a crossroads of seasonal stock transfer going to and from the Pontine marshes.
For these reasons, on a hill around 1000 AD a fortified settlement was built which then welcomed people.
The first mention of Pofi is in a document dated 1039 from the diocese of Veroli, which entrusts it to the lords of Ripi. In the wars between the papacy and the empire it was set on fire in 1155 and destroyed in 1186 by the German troops of Henry VI.
At the end of the thirteenth century it was given to the Caetani family who kept it until 1459 when the estate passed to the Colonna, who kept it until 1816. At the beginning of the sixteenth century, the consolidated Colonna organized their local militia in Pofi and those units participated in several anti-papal struggles. Some soldiers fought with Marcantonio Colonna at the Battle of Lepanto. But Pofi was the southern capital of the state of the Colonna within the papal domain. Here the general auditor was located along with his bureaucratic apparatus that dealt with justice and security. The status of the Colonna included fifteen fiefdoms and, in 1734, the capital was moved to Ceccano.
In the mid-seventeenth century the plague decimated the population after which Pofi started again to grow and develop. The social structure evolved and formed a class of landowners. Some of them acquired the noble title such as De Carolis, known for their building. The affirmation of new families helped to trigger the end of the Colonna domination.
The fortress, which ended its military function, was destined for the local authorities and the Colonna Palace was sold to private owners.
After 1870, with the unification of Italy, a slow but substantial emigration from the town began. During World War II the town was not particularly affected but the population dispersed.