Data preparation and feature engineering steps should be done in a separate project to match the expected format of the input datasets. Respecting the expected data model when loading new data helps ensure the results are reliable and easy to interpret.

# Input datasets format
### Clinical Notes
Required schema for the input dataset:
| column name | description                                             |
|-------------|---------------------------------------------------------|
| patient_id  | the unique identifier for a patient                     |
| note_id     | the unique identifier for a clinical note               |
| sex         | the sex of the patient                                  |
| age         | the age of the patient                                  |
| note        | the full text of a clinical note for one clinical visit |