Explanation:

Add the pickupDate column: .withColumn( " pickupDate " , df[ " pickupDateTime " ].cast( " date " )) Filter the DataFrame: .filter( " fareAmount > 0 AND fareAmount < 100 " ) In PySpark, you can add a new column to a DataFrame using the .withColumn method, where the first argument is the new column name and the second argument is the expression to generate the content of the new column. Here, we use the .cast( " date " ) function to extract only the date part from a timestamp. To filter the DataFrame, you use the .filter method with a condition that selects rows where fareAmount is greater than 0 and less than 100, thus ensuring only positive values less than 100 are included.