Since he began dating Jennifer Aniston in 2011, Justin Theroux has become a frequent fixture in the tabloid rumor mill. But the actor insists he doesn’t let the constant marriage and pregnancy talk get to him.

“There is this hum of pressure that — I can’t stress enough — I just don’t pay any attention to,” Justin says about the interest in his personal life.

justin theroux

“I am not going to let a tabloid tell me what to do…I’m not going to watch them tap their watch,” the 43-year-old adds. “What the hell are you telling me to do?”

Engaged since August 2012, The Leftovers star tells Australia’s TV Week that although he is extremely happy “both personally and professionally,” he’s “not on anyone else’s timeframe” when it comes to walking down the aisle.

Related: Jennifer Aniston Gushes About Her “Beautiful & Handsome” Fiancé Justin Theroux

“We’re just doing our own thing,” he says of his relationship with the former Friends actress.

But don’t confuse Justin’s laid-back attitude toward matrimony as a lack of passion. “I think love in anyone’s life creates expansion. And needless to say, it feels really good,” he gushed to the mag about his leading lady.