AI Uncovers Racial Restrictions in Millions of California Property Records

AI finds racial restrictions in millions of property records

California law requires counties to remove racially restrictive language -- constitutionally unenforceable since 1948 -- from property deeds. Researchers trained a large language model to help. When Dan Ho purchased a home in Palo Alto, he recounts, "We had to sign papers that said that the 'property shall not be used or occupied by any person of African, Japanese or Chinese or any Mongolian descent,' except for the capacity of a servant to a white person." "It was a stunning testament to housing discrimination in the area and it's been constitutionally unenforceable since 1948," said Ho, the William Benjamin Scott and Luna M. Scott Professor of Law, Director of RegLab, and Senior Fellow at Stanford University Human-Centered Artificial Intelligence, or HAI. Despite the Supreme Court holding such clauses unenforceable, racially restrictive covenants still litter deed records across the country. In 2021, California enacted a law that required the state's 58 counties to create programs to identify and redact deed records that include racial covenants. But the new law also poses a daunting task: Santa Clara County alone has 24 million deed documents, totaling 84 million pages, dating back to 1850. "Prior to this collaboration, our team manually read close to 100,000 pages over weeks to identify racial covenants," Assistant County Clerk-Recorder Louis Chiaramonte said, "and it was a challenging undertaking." To comply with the law, some California counties contracted with commercial vendors. Los Angeles County, for instance, hired a company for $8 million to conduct this scan over seven years. In other jurisdictions, teams of citizens have valiantly crowdsourced these efforts with thousands of volunteers pouring over deed records. But not all jurisdictions have such resources. The County of Santa Clara, home to Silicon Valley, approached it differently. Stanford University's Regulation, Evaluation, and Governance Lab (RegLab) partnered with the County to use the power of AI -- and large language models, specifically -- to assist in this monumental task. "The County of Santa Clara has been proactively going through millions of documents to remove discriminatory language from property records," said Chief Operating Officer Greta Hansen. "We're grateful for our partnership with Stanford, which has helped the County substantially expedite this process, saving tax-payer dollars and staff time." The team, led by Stanford's RegLab and including HAI affiliates and Princeton Professor Peter Henderson, curated a collection of racial covenants from various jurisdictions in the country and trained a state-of-the-art open language model to detect racial covenants, with almost perfect accuracy. The team has released the paper at https://reglab.github.io/racialcovenants/ and is making the model available to enable all jurisdictions faced with this task to identify, redact, and develop historical registers of racial covenants more effectively. "We estimate that this system will save 86,500 person-hours and cost less than 2% of what comparable proprietary models would have," said co-lead author Faiz Surani, a fellow with the RegLab. The team zoomed in on 5.2 million deed records between 1902-1980, the period most at issue. The team also figured out a way to cross-reference historical maps to locate most of these properties. They matched textual descriptions of maps (e.g., "Map [that] was recorded ... June 6, 1896, in Book 'I' of Maps at page 25.") to administrative records in the Santa Clara County Surveyor's Office to geolocate tracts. "Of all the items coming out of the state law, we thought that mapping could have been nearly impossible," Chiaramonte said. These maps revealed extraordinary insights into the evolution and diffusion of racial covenants in Santa Clara County: "We believe this is a compelling illustration of an academic-government collaboration to make this kind of legislative mandate much easier to achieve and to shine a light on historical patterns of housing discrimination," said co-lead Mirac Suzgun, a JD/Ph.D. student in computer science. Chiaramonte agreed: "This collaboration paved a new path for how we can use technology to achieve the momentous mandate to identify, map, and redact racial covenants. It reduced the amount of time our team needed to review historical documents dramatically."

AI finds racial restrictions in millions of property records

Despite the Supreme Court holding such clauses unenforceable, racially restrictive covenants still litter deed records across the country. In 2021, California enacted a law that required the state's 58 counties to create programs to identify and redact deed records that include racial covenants. But the new law also posed a daunting task: Santa Clara County alone has 24 million deed documents, totaling 84 million pages, dating back to 1850. "Prior to this collaboration, our team manually read close to 100,000 pages over weeks to identify racial covenants," Assistant County Clerk-Recorder Louis Chiaramonte said, "and it was a challenging undertaking." To comply with the law, some California counties contracted with commercial vendors. Los Angeles County, for instance, hired a company for $8 million to conduct this scan over seven years. In other jurisdictions, teams of citizens have valiantly crowdsourced these efforts with thousands of volunteers pouring over deed records. But not all jurisdictions have such resources. The County of Santa Clara, home to Silicon Valley, approached it differently. Stanford University's Regulation, Evaluation, and Governance Lab (RegLab) partnered with the County to use the power of AI - and large language models, specifically - to assist in this monumental task. "The County of Santa Clara has been proactively going through millions of documents to remove discriminatory language from property records," said Chief Operating Officer Greta Hansen. "We're grateful for our partnership with Stanford, which has helped the County substantially expedite this process, saving tax-payer dollars and staff time." The team, led by Stanford's RegLab and including HAI affiliates and Princeton Professor Peter Henderson, curated a collection of racial covenants from various jurisdictions in the country and trained a state-of-the-art open language model to detect racial covenants, with almost perfect accuracy. "We estimate that this system will save 86,500 person-hours and cost less than 2% of what comparable proprietary models would have," said co-lead author Faiz Surani, a fellow with the RegLab. The team zoomed in on 5.2 million deed records between 1902-1980, the period most at issue. The team also figured out a way to cross-reference historical maps to locate most of these properties. They matched textual descriptions of maps (e.g., "Map [that] was recorded . . . June 6, 1896, in Book 'I' of Maps at page 25.") to administrative records in the Santa Clara County Surveyor's Office to geolocate tracts. "Of all the items coming out of the state law, we thought that mapping could have been nearly impossible," Chiaramonte said. These maps revealed extraordinary insights into the evolution and diffusion of racial covenants in Santa Clara County: 1) The team estimated that one in four properties in Santa Clara County were subject to racial covenants as of 1950. 2) Only 10 developers were responsible for a third of the identified covenants, suggesting that developers had a lot of say in how Santa Clara County was constructed. 3) Racial covenants excluded African Americans at the same rate as Asian Americans, even when African American residents were less than a tenth the size of the Asian American population. 4) The team found a striking instance of a San Jose-owned cemetery that included burial deeds only for "Caucasians." This goes against the conventional historical account that racial covenants were used only between private parties after the Supreme Court banned state-based racial zoning.