Ivanović's mother Dragana, a lawyer, supports her daughter during most of her matches. Her father Miroslav, a self-employed businessman, attends as many events as he possibly can. Ana has a younger brother, Milos, with whom she loves to play basketball.
 Personal life
Aside from her tennis career, Ivanović also studies finance at a university in Belgrade and Spanish in her spare time. Her inspiration to begin playing was Monika Seleš, who at that time played for Yugoslavia.
On September 8, 2007, Ivanović became a UNICEF National Ambassador for Serbia, alongside Aleksandar Đorđević, Jelena Janković and Emir Kusturica. She takes a special interest in the fields of education and child protection. Ivanović visited a primary school in Serbia during her inauguration and said that she is "also looking forward to going into the classroom and meeting many kids."
Ivanović picked up a racket at the age of five after watching Monica Seles, a fellow Yugoslav, on television. She started her career after memorizing the number of a local tennis clinic from an advertisement. At the time, she was forced to train during the morning to avoid bombardments. Later, she admitted that she trained in an abandoned swimming pool in the winter, as there were no other facilities. When she was 15, Ivanović spent four hours in the locker room crying after a defeat — the first that her new manager had watched. She thought that Dan Holzmann, the manager in question, would drop her, thinking that she was not good enough to become a professional tennis player. He has stayed her manager to this day.
Ivanović reached the final of the Junior Wimbledon tournament in 2004, losing to Kateryna Bondarenko. In 2004, she went 26–0 on the ITF circuit, and won all five events that she entered, two of them as a qualifier. As a qualifier in Zürich, she overcame a 5–1 third set deficit along with two match points to defeat World no. 29 Tatiana Golovin. She then debuted in the qualifying draw of a Grand Slam at the 2004 US Open, where she was defeated by Lioudmila Skavronskaia after winning the first set 6–1. She eventually fell to a close loss, 6–1, 4–6, 5–7. Her first professional breakthrough occurred in the next match, when she took Venus Williams to two tiebreaks before losing in straight sets in the second round of the Zürich Open. She had held several set points in both sets. She followed up her run in Zürich with a quarterfinal showing at Luxembourg the next week.
Ivanović won her first career singles title, as a qualifier, in Canberra, Australia, after defeating Melinda Czink in the final. Her ranking continued to rise after wins over Svetlana Kuznetsova, Nadia Petrova, and Vera Zvonareva, all of whom were top 10 players. Ivanović lost to Amélie Mauresmo at the Australian Open, Doha, and Miami Masters, before defeating her in the third round of the French Open. At that stage in her career it was arguably her biggest win. Ivanović eventually reached the quarterfinals of that tournament, where she lost to Petrova. Later in the year, Ivanović reached the semifinals of the Zurich Open and Generali Ladies Linz, losing to Patty Schnyder in both tournaments.