Giacomo Altoviti was born in 1604 in Florence. His father was Lorenzo Altoviti, a rich papal banker, Florentine senator and preferred nephew of his uncle cardinal Giovanni Bonsi. His father was also the brother of Francesca Sacchetti Altoviti, mother of the late cardinal Giulio Cesare Sacchetti and Marcelo Sacchetti, papal treasurer of Urban VIII.
Giacomo Altoviti attended the Roman seminary and became a close friend to Fabio Chigi. Giacomo Altoviti followed his friend when Fabio Chigi was appointed by Urban VIII papal legate to Ferrara and in Mata, when his friend and protector was sent there in 1635 as inquisitor and apostolic visitor. He also took part in Fabio Chigi appointment to the cardinalate, using his influence with his cousin cardinal Giulio Cesare Sacchetti, who had already had the opportunity to appreciate Chigi's talents and to conceive a profound esteem for him. Later the Altoviti and Sacchetti supported Fabio Chigi in the negotiations and conclave of that led to his election as Pope Alexander VII.[4]