PySpark Explained: Dealing with Invalid Records When Reading CSV and JSON Files | Towards Data Science

Effective techniques for identifying and handling data errors