Though 'It Ends With Us' takes place in Boston, it was actually largely filmed in New Jersey Sony Pictures Entertainment Colleen Hoover’s book comes to life with the recent movie adaptation, but some iconic locations may look a bit different on screen. Starring and , the movie follows a young woman named Lily Bloom who moves to a new city and eventually meets and falls in love with a man named Ryle. However, their relationship eventually becomes toxic as Ryle becomes physically and emotionally abusive.

Among various , the filming locations also strayed from the source material. While the book and movie are both set in Boston, . Ahead of the release, PEOPLE spoke exclusively with one of the film’s location managers, Jeff Brown, who spoke extensively about the biggest settings from the book and how they were adapted for the screen.

On why the filmmakers decided on New Jersey as the backdrop instead of Boston, he noted that the decision “was primarily a financial decision,” but the crew worked hard to give the Garden State an authentic New England feel. “I think Justin had really fallen in love with a lot of the looks of Jersey as Boston and we were really trying to keep his vision of what he had seen alive,” he said of Baldoni, who also and producer for the project. “We all knew from the book and from the script that Boston was a major part of the story.

So with locations, sometimes you're looking for things that are underneath the story in a way. What sells Bosto.