No matter what happens, John Dutton will always be the patriarch of the Dutton family.

As the premiere of the highly anticipated final episodes of Yellowstone is approaching, Christina Voros, who directed four of the six remaining episodes, sheds new light on how Kevin Costner’s character will continue to be part of the family’s story despite the actor leaving the show.

“His presence is integral,” Voros said The Hollywood Reporter of how Costner’s character influences the final episodes.

While she hasn’t revealed much about what that means – “I think if I said more it would potentially jeopardize all the work that had gone into editing the scripts,” she said – Voros reaffirmed that ‘he is the patriarch and his presence is an essential part of the story.”

“John Dutton is still central.”

Production on the final episodes of the hit Western series began in May, after months of back-and-forth between Coster, 69, and creator Taylor Sheridan.

Costner told PEOPLE that he was “disappointed” by the story that emerged about the creative differences between him and Sheridan on the show, as he said the real reason behind his departure was that “the scripts weren’t there.”

“There was a point where that show stopped for me for fourteen months… That’s the fact. I could have done a lot of things in that time, but I wasn’t aware that that (robbery) was going to happen,” he said .

“I was disappointed that no one on their side… ever stood up to defend what I actually did for them. There came a point where I thought, ‘Wow, when is someone going to say something about what I did versus what I have done?’ What haven’t I done?'”

In June, the actor confirmed in an Instagram post that he would not return to the show, calling Yellowstone a “beloved series that I love.”

“I just realized I can’t continue season 5b or the future,” he said in a video. “It was something that really changed me. I loved it, and I know you loved it. I just wanted to let you know that I’m not coming back.”

Despite all the back and forth, the cast is happy with how the series is ending. Luke Grimes, who plays Kayce Dutton, shared Entertainment weekly last month that he “couldn’t be happier” about the finale.

“I think it’s a perfect ending for the show for every character,” he said. “It’s just a testament to what a good writer Taylor is, and it’s a very, very deep, beautiful ending. I can’t wait to sit down.” and look at it.”

His co-star Kelly Reilly, who plays his sister Beth Dutton, echoed his praise when she said the “scripts on the last episode were so good.”

Never miss a story: Sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

The last episodes of Yellowstone Season 5 premieres Sunday, November 10 at 8:00 PM ET/PT on Paramount Network.