James Goldstein -- who owns the famed Sheats-Goldstein Residence in the Beverly Crest hood of L.A. -- tells TMZ he recently had a face-to-face with Ye ... and not just that, but it sounds like they're gonna be working together on an architectural project.

That project, we're told, encompasses some complex plans KW has for his newly purchased mansion along the coast ... ones he believes Goldstein can advise him on, considering his experience in this field.

If you don't know ... JG's house is perhaps the most awe-inspiring in all of La La Land, due to its mind-bending construction and elaborate architecture -- most of which was undertaken by the late John Lautner, who teamed up with James years ago to bring his vision to life.

With that in mind, we're told James got a call from Kanye last week to see if they could link up and talk shop about home design -- and after sending his own architect out to inspect James' place, he tells us the man himself paid a visit on Friday to see it himself.

James says Ye toured the grounds thoroughly, taking pics and complimenting certain features he found wowing -- like the stairway and the pool -- and eventually came clean on what he wanted ... namely, for him (James) to come over to the 'Bu and help with his project.

James says Ye is interested in James' expertise and perspective, and indeed ... he accepted his request. Now, as for what exactly Kanye is cooking up, JG says he actually showed him some drawn-up rectangular-based plans -- but couldn't really make sense of it, so he's gonna swing by in person soon to talk in more detail and figure out what Ye's got in mind.