I need to rewatch this movie.
You really don't. It's pish.
The bottom line is that Bond has been tweaked multiple times over the years including by Fleming himself. In terms of the films he has been updated multiple times to keep the films current, with the principal things they've kept being that has a military background, is an orphan and is a bit edgy. There is no reason why a non-white actor couldn't play that and be in keeping with the part, so long as he was right for it. But the next "right person the role" could just as easily be white. My two picks would be Chiwetel Ejiofor or if they reboot a bit more and go younger, Nicholas Hoult.