Well, I just finished reading an older version of his bio. He did compete in one really big one at Madison Sq. Garden and he most certainly bore the brunt of some racist tactics. There was so much description of what the other racers did to him, I can't remember what specifically happened. It was shameful. Another reason why he didn't do more is that he wouldn't race on Sundays. But the other racers, one in particular, did everything in his power to keep him out of a lot of races, because he was scared to death that a Black man would beat him. So even though this was a super popular form of racing and Taylor wanted to do more, he couldn't.
It was hard to believe, though, that in 1900 there were thousands of people at these races!