Photo: Tyler Golden/ABC

CELEBRITY JEOPARDY! - “Quarterfinal #5: Troian Bellisario, Wil Wheaton and Hasan Minhaj”

Hasan Minhajhad a few things to say about the response he’s received after appearing onCelebrity Jeopardy!

ThePatriot Acthost confronted the intense backlash from his appearance on the long-running game show during a sit-down withJimmy Fallonon Thursday’s episode ofThe Tonight Show.

“This past week I was onCelebrity Jeopardy!and now fans ofJeopardy!hate my guts,” Minhaj, 37, told Fallon, 48. “I have this unique power to piss off dedicated nerds.”

Handily, Fallon’s crew had crafted a supercut of Minhaj’s most animated moments — actions that led someTwitter usersto deem"annoying"and"painfully unfunny.“One critic went so far as to call Minhaj theworst contestant inJeopardy!history.

“I was just playing with vigor and passion,” Minhaj told Fallon.

“I was into it,” Minhaj said after the clip played. “If you get it right, hang on the rim.”

But, he acknowledged, the “fans weren’t having it.”

Minhaj did single out one comment as especially tough to take — the slam that he was “the most annoying contestant” in the show’s history.

“That one hurt because, you know, the show’s been on for over 58 years — and they’ve had 15,000 contestants on the show. AndDr. Ozwas a contestant,” he said.

The comedian — who’d told hostMayim Bialikduring his appearance in the tournament that he first connected toJeopardy!while watching with his father — then quipped, “Maybe my dad was wrong. He said I’d never break records on that show.”

Santiago Felipe/Getty

Hasan Minhaj attends NRDC’s “Night of Comedy” Honoring Anna Scott Carter at Casa Cipriani on September 20, 2022 in New York City.

Minhaj then set the stage for an apology toJeopardy!fans — though it didn’t go as expected.

“To the fans ofJeopardy!,” he began, reading from a notecard.

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

TheCelebrity Jeopardy!tournament continues — without Minhaj — Sunday at 9 p.m. ET on ABC.

source: people.com