2016-07-22 13:35:50 +00:00
The instructions are for a Windows machine, but it should be fairly easy to adapt them to other operating systems
0. You need to acquire the following AU datasets for the code to work (if you do not have some of them you will need to modify the code slightly to account for that):
- Bosphorus (http://bosphorus.ee.boun.edu.tr/)
- BP4D from FERA2015 (http://sspnet.eu/fera2015/)
- DISFA (http://www.engr.du.edu/mmahoor/DISFA.htm)
- FERA2011 (http://sspnet.eu/fera2011/fera2011data/)
- SEMAINE from FERA2015 (http://sspnet.eu/fera2015/)
- UNBC (http://www.pitt.edu/~emotion/um-spread.htm)
1. First compile the 64-bit C++ models to be able to extract the features (possible to use 32-bit models as well but default path assumes 64 bit)
2016-06-03 13:33:04 +00:00
2. Extract features using scripts in the "data extraction" folder, this allows to build a PCA subspace for HOGs that is relevant to faces and facial expressions
2016-07-22 13:35:50 +00:00
- change the directory locations to where you downloaded the datasets from step 0
2016-06-03 13:33:04 +00:00
- run all of the extract_features_*.m scripts
- this will take some time: 4-20 hours depending on your machine as you will need to process a lot of visual data
- you need to make sure you have the right datasets and they are in the right locations
2016-07-22 13:35:50 +00:00
3. Create a PCA model
- run the createSubFaceModels.m in the pca_generation folder
- this will create a full, lower and upper face PCAs
- this will take some time (30-60 minutes or so) and require lots of RAM (up to 16GB)
4. Training the actual models, go to experiments/full_model_training
- train_static_regressors.m
- train_static_classifiers.m
- train_dynamic_regressors.m
- train_dynamic_classifiers.m
- train_static_regressors_with_classifiers.m
- train_dynamic_regressors_with_classifiers.m
- this will create the .dat files that can be used with the C++ code for AU prediction
