The Depression dampened the growth of Los Angeles, but Williams’ practice prospered as Hollywood lifted America’s spirit, and entertainers commissioned houses and vacation retreats. His clients included movie idols Tyrone Power, Bill (Bojangles) Robinson, Barbara Stanwyck, Lon Chaney and Johnny (Tarzan) Weissmuller. Beverly Hills entrepreneurs engaged Williams to bring his residential panache to their enterprises, including Music Corporation of America and Saks Fifth Avenue.
For all Williams’ success and though he lived in one of the least discriminatory cities in America, racial injustice framed his world. He designed mansions in Beverly Hills but couldn’t live there; he designed elegant shops and restaurants where he was unwelcome. In Nevada, where he had many clients, he could not find commercial lodging, food or office space. Traveling to Washington, D.C., where he opened an office with African American architect Hilyard Robinson, he had to “ride in the ‘Jim Crow’ car.” In a 1937 article, Williams wrote candidly about these experiences, his success and his belief that leaders like actor Paul Robeson and educator Mordecai Johnson of Howard University demonstrated and inspired the advancement of the race.