BMX Olympian Connor Fields Doesn't Feel '100% Normal' After 'Nightmare' Injury in Tokyo

Olympic BMX racer Connor Fields is on the mend after suffering serious injury at the Tokyo Summer Games.

Speaking to The New York Times Thursday, the 28-year-old gold medalist spoke about recovering from a brain hemorrhage, broken rib, and bruised lung following the frightening wreck during the race semifinals — which he doesn't even remember.

"I'd rather tear every ligament in my body before I had a gnarly concussion," Fields said. "This was my nightmare."

Dr. Jonathan Finnoff — chief medical officer for the U.S. Olympic and Paralympic Committee — tended to Fields after the crash and during his early care.

"It was the worst injury the Olympics had," he told the Times. "Not just Team U.S.A. It was the worst injury of the Tokyo Summer Games."

After the accident, the BMX star, who won gold at the 2016 Rio de Janeiro Olympics, spent a week at the hospital in Tokyo, before flying back to Las Vegas for weeks of evaluation and therapy.

"The first thing that started to really come back was the physical side of it — my balance, my coordination," Fields said. "Within three weeks I was able to balance on one leg just fine, and do tasks that would have been hard for me initially."

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

He said the focus now has been centered around processing speed and recall, noting during the interview that therapy consists of performing brain teasers that can get tiring. Fields explained that he still has blank spots in his memory from before and after the crash.

"I don't feel 100% normal, but pretty close to normal when I'm fresh," he explained. "But when I get tired, it reverts back to how I was early on."

The athlete added, "The way I feel today is not how I want to feel for the rest of my life."

For now, Fields is taking it slow, sharing that he's not even cleared to take an easy bike ride through his neighborhood, the Times reports.

"We're talking about the rest of my life here," he said. "I can wait a few months, if it means not hurting my brain anymore."

Though he's not sure what's next for his racing career, Fields revealed "Nobody close to me has any interest in me coming back."