Doria Raglandis “ready” to have her “voice heard.”

The mother ofMeghan Marklespoke out for the first time in her daughter and son-in-lawPrince Harry’s newNetflixdocuseriesHarry & Meghan, in which she admits “the last five years have been challenging.”

Recalling how Meghan, 41, first told hershe was dating the royal, Doria, 66, said, “We were on the phone and she says, ‘Mommy, I’m going out withPrince Harry,’ and I start whispering, ‘Oh my God.’ "

“And so it was from the beginning, it was very sort of, ‘Oh my God, nobody can know,’ " she continued in her interview, which takes place in the series' third episode.

OfPrince Harry, 38, Doria said she noticed he was “handsome” and “really nice” upon first meeting him,with “really great manners.”

“And they looked really happy together,” she added. “Once it was announced that they were together, it seemed kind of like a novelty.”

Doria Ragland.Netflix

Harry & Meghan Netflix Documentary

For more on Prince Harry and Meghan Markle’s Netflix docuseries, listen below to our daily podcast PEOPLE Every Day.

“I felt unsafe a lot. I can’t just go walk my dogs. I can’t just go to work. There was always someone there waiting for me,” she explained.

Can’t get enough ofPEOPLE’s Royals coverage?Sign up for our free Royals newsletterto get the latest updates onKate Middleton,Meghan Markleand more!

Meghan Markle and Doria Ragland.Sylvain Gaboury/Patrick McMullan via Getty

Meghan Markle and Doria Ragland attend UN Women’s 20th Anniversary of the Fourth World Conference of Women in Beijing at Manhattan Centre at Hammerstein Ballroom on March 10, 2015 in New York City.

Doria was theonly member of Meghan’s familywho attendedher wedding to Prince Harryback in May 2018 and currently lives near the couple and their two children — sonArchie Harrison, 3½, and daughterLilibet Diana, 18 months — in California.

Speaking aboutracism Meghan has facedin the public eye, Doria said, “As a parent, in hindsight, absolutely, I would like to go back and have that kind of real conversation about how the world sees you.”

RELATED VIDEO: Netflix Releases First Trailer forMeghan MarkleandPrince Harry’s New Docuseries

Meghan herself explained in the series that while “obviously now people are very aware of my race because they made it such an issue when I moved to the U.K.,” it wasn’t always that way.

“Before that, most people didn’t treat me like a Black woman so that talk didn’t have to happen for me,” she noted.

But the negative words in the media caused Doria to tell her daughter, “‘This is about race,‘and Meg said, ‘Mommy, I don’t want to hear it.’ "

“But this is what is coming down the pike,” Doria added.

The first three episodes ofHarry & Meghanare now streaming on Netflix.

source: people.com