Spectacular Mood Meter - for V2_'s Evening of the Black Box.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Ruben b6ab33ab97 Merge branch 'master' of rubenvandeven.com:~/git/crowdcamera 5 years ago
cmake_modules Add custom module 7 years ago
common Read subsequently numbered files 5 years ago
opencv-webcam-demo Edits for live 5 years ago
video-demo Fix 3.4 bug (#36) 5 years ago
.gitignore Initial commit 8 years ago
.travis.yml Fix 3.4 bug (#36) 5 years ago
CMakeLists.txt Fix a bug where the screen hangs in the case of photo/video 7 years ago
ISSUE_TEMPLATE.txt "leverage" -> "use" 5 years ago
LICENSE.txt Add license file to the repository 7 years ago
README.md update pipeline info 5 years ago
affdex-win-samples.sln Fix 3.4 bug (#36) 5 years ago
appveyor.yml Fix 3.4 bug (#36) 5 years ago
console.html Fun from cli and host as websocket 5 years ago
graphs.php Merge branch 'master' of rubenvandeven.com:~/git/crowdcamera 5 years ago
images.php Edits for live 5 years ago
lodash.core.min.js Version ready for live 5 years ago
parse_output.py Edits for live 5 years ago
plotly-1.31.2.min.js Version ready for live 5 years ago
requirements.txt Fun from cli and host as websocket 5 years ago
run.py Read subsequently numbered files 5 years ago
split_and_merge_output.py Edits for live 5 years ago

README.md

The crowd will tell us

Pipeline

  • Gphoto2 takes pictures (not vm) into a 'pictures/{1,2,3}' dir.
  • These get splitted by split_and_merge_output.py to a 'segments' subdir. (To be able to detect smaller faces)
  • Our modified opencv-webcam-demo will analyse these images and output json
  • The same split_and_merge_output.py process will detect the segment jsons and merge them back into the 'pictures/{1,2,3}' dir. It subsequently deletes the segmented photos

[TODO: remove duplicate faces on merge]

Now we have our dataset of photo's with JSONS.

To output:

  • parse_output.py -o ~/pictures/{1,2,3} --json --window-size 10 > ~/sdk-samples/output/talk1.json Creates a json file suitable for webbrowser graphing
  • python parse_output.py -o ~/pictures/{1,2,3} --wav ~/pictures/{1,2,3}.wav --targetDir /home/crowd/sdk-samples/output/1 --window-size 10 Assumes a WAVE file that starts simultaneously with frame 1. and splits it into the windows
  • Start server for graph.php & image.php cd ~/sdk-samples && php -S 0.0.0.0:8000
  • Navigate to: http://192.168.178.33:8000/graphs.php to view images

Done :-)

Commands

Start a few processes:

gphoto2 to capture images every 2 sec:

gphoto2 --port usb: --capture-image-and-download -I 2 --filename=/home/crowd/output/frame%06n.jpg

SET FPS IN parse_output.py

If using Sony A7s/r, Ubuntu 14.04 has a too old version of gphoto2, so use vm-host with gphoto. Mount pictures dir to vbox:

sudo mount -t vboxsf pictures ~/pictures -o rw,uid=1000,gid=1000

The modified 'webcam demo' to analyse and generate json:

/home/crowd/build/opencv-webcam-demo/opencv-webcam-demo --data /home/crowd/affdex-sdk/data --faceMode 1 --numFaces 80 -o /home/crowd/output/segments/ --draw 0 --segments 1

When using --segments 1 also run:

python split_and_merge_output.py --frameOutput ~/output --segmentDir ~/output/segments/

Using split_and_merge_output, frames are split into segments so SMALL_FACES actually detects really small faces. This requires enabling --segments on opencv-webcam-demo (so it detects/writes segment%06d files) split_and_merge_output also remerges these segment%06.json files into a frame%06d.json file.

When done, generate output:

parse_output.py -o ~/output1 --json --window-size 1 > ~/sdk-samples/output/talk1.json parse_output.py -o ~/output2 --json --window-size 1 > ~/sdk-samples/output/talk2.json parse_output.py -o ~/output3 --json --window-size 1 > ~/sdk-samples/output/talk3.json

and audio, which expects wav to start simmmultaneously with frame00001:

python parse_output.py -o ~/pictures/1 --wav ~/pictures/1.wav --targetDir /home/crowd/sdk-samples/output/1 --window-size 1 python parse_output.py -o ~/pictures/2 --wav ~/pictures/2.wav --targetDir /home/crowd/sdk-samples/output/2 --window-size 1 python parse_output.py -o ~/pictures/3 --wav ~/pictures/3.wav --targetDir /home/crowd/sdk-samples/output/3 --window-size 1

Then start server:

cd ~/sdk-samples && php -S 0.0.0.0:8000

Navigate to: http://192.168.178.33:8000/graphs.php to view images