HUJI EgoSeg Dataset

Dataset

This dataset contains 122 videos captured from an egocentric camera. The first 44 videos (filenames Huji_*) were shot by us using a head-mounted GoPro Hero3+. The next set are videos curated from YouTube to form 7 additional wearer activity categories. We also used videos from the First-Person Social Interactions [1] and GTEA Gaze+ [2] datasets.

Please check out our EgoSeg project page.

Videos

Subject	Sequence Name	Size	Link
Chetan*	Huji_Chetan_1	452MB	[MP4]
	Huji_Chetan_2	1701MB	[MP4]
	Huji_Chetan_3_Passenger_part1	3727MB	[MP4]
	Huji_Chetan_3_Passenger_part2	897MB	[MP4]
	Huji_Chetan_4_Dinner_Part1	623MB	[MP4]
	Huji_Chetan_4_Dinner_Part2	621MB	[MP4]
	Huji_Chetan_4_Dinner_Part3	616MB	[MP4]
Yair*	Huji_Yair_1_part1	3727MB	[MP4]
	Huji_Yair_1_part2	1332MB	[MP4]
	Huji_Yair_2	1332MB	[MP4]
	Huji_Yair_3	972MB	[MP4]
	Huji_Yair_4	945MB	[MP4]
	Huji_Yair_5	636MB	[MP4]
	Huji_Yair_6	623MB	[MP4]
	Huji_Yair_7_part1	3727MB	[MP4]
	Huji_Yair_7_part2	1740MB	[MP4]
	Huji_Yair_8_part1	3726MB	[MP4]
	Huji_Yair_8_part2	289MB	[MP4]
	Huji_Yair_9_part1	3727MB	[MP4]
	Huji_Yair_9_part2	949MB	[MP4]
	Huji_Yair_10_Lighttrain	1029MB	[MP4]
	Huji_Yair_11_Lighttrain	970MB	[MP4]
	Huji_Yair_Sitting_Eating1	3672MB	[MP4]
	Huji_Yair_Standing_Grass1	3051MB	[MP4]
Ariel	Huji_Ariel_1	3934MB	[MP4]
	Huji_Ariel_2	3934MB	[MP4]
	Huji_Ariel_3	967MB	[MP4]
	Huji_Ariel_4	3934MB	[MP4]
	Huji_Ariel_5	3934MB	[MP4]
	Huji_Ariel_6	1858MB	[MP4]
	Huji_Ariel_7	709MB	[MP4]
	Huji_Ariel_8	3934MB	[MP4]
	Huji_Ariel_9	1020MB	[MP4]
	Huji_Ariel_10	3934MB	[MP4]
	Huji_Ariel_11	2941MB	[MP4]
	Huji_Ariel_12	3149MB	[MP4]
	Huji_Ariel_13	1435MB	[MP4]
	Huji_Ariel_14	3934MB	[MP4]
	Huji_Ariel_15	2468MB	[MP4]
	Huji_Ariel_16	579MB	[MP4]
	Huji_Ariel_17	504MB	[MP4]
	Huji_Ariel_18	599MB	[MP4]
	Huji_Ariel_19	976MB	[MP4]
	Huji_Ariel_20	574MB	[MP4]
Youtube	Biking Playlist*	5 Vids	[Youtube]
	Sailing Playlist	15 Vids	[Youtube]
	Horseback Playlist	9 Vids	[Youtube]
	Skiing Playlist	9 Vids	[Youtube]
	Stair Climbing Playlist	9 Vids	[Youtube]
	Running Playlist	7 Vids	[Youtube]
	Boxing Playlist	24 Vids	[Youtube]
GTEA Gaze+^[2]	Cooking Dataset	30 Vids	[Link]
Chetan, Yair, Ariel	Huji_*	44 Vids (83GB)	[tar]

* denotes videos which comprised the dataset of our CVPR'14 work.

Annotations

Ground truth annotations containing temporal segmentation of all videos into 14 different camera wearer activities are available here.
We used ELAN for annotations. To process the annotations in Matlab we developed helper functions to both read and write .EAF files, see here.

Publications

Please cite the following papers if you use this dataset:

@inproceedings{poleg_wacv16_compactcnn,
  title     = {Compact CNN for Indexing Egocentric Videos},
  author    = {Yair Poleg and Ariel Ephrat and Shmuel Peleg and Chetan Arora},
  year      = {2016},
  booktitle = {WACV}
}

@inproceedings{poleg_cvpr14_egoseg,
  title     = {Temporal Segmentation of Egocentric Videos},
  author    = {Yair Poleg and Chetan Arora and Shmuel Peleg},
  year      = {2014},
  booktitle = {CVPR}
}

References

[1] Alireza Fathi, Jessica K. Hodgins, James M. Rehg, Social Interactions: A First-Person Perspective, CVPR 2012.
[2] Alireza Fathi, Yin Li, James M. Rehg, Learning to recognize daily actions using gaze, ECCV 2012.