Matching slides to presentation videos using SIFT and scene background matching
- Quanfu Fan
- Kobus Barnard
- et al.
- 2006
- MM 2006
Dr. Amir is a Senior Research Scientist in the Brain Inspired Computing group at the IBM Almaden Research Center, where he currently works on the Northpole AI chip. Prior to Northpole he worked on the TrueNorth neuromorphic chip. As a member of the software team, he develops the Corelet Programming Language - a hierarchical, compositional language for programming the TrueNorth chip. He also uses it to create some useful corelets and demos, such as event-based gesture recognition using a Dynamic Vision Sensor (DVS) camera.
In 2008 Dr. Amir started and lead the DuraBytes project, where he was the visionary, initiator and co-inventor of the IBM Linear Tape File System (LTFS). With the goal in mind to make data tapes more useful for the Media and Entertainment (M&E) industry, Arnon was very intrigued by The Digital Dilemma - a 21st century challenge to M&E and many other industries. By making data tapes self-describing, self-contained and easy to use, the formerly called 'backup tape' has now much of the properties and ease of use of a portable hard drive, combined with tape's native high-density, long longevity and low power efficiencies. LTFS makes data tapes well suited for Digital Media Workflows, ironically called also Tapeless Workflows because they are file-based, thus replacing the video-cassette ☺. IBM LTFS is now available as part of IBM Spectrum Archive. LTFS has been adopted by many companies into their own products, and has received broad recognition and several prestigious awards, including an EMMY and the Hollywood Post Alliance Award. It is now the ISO/IEC 20919:2016 standard.
Other projects since joining IBM Almaden in 1997 include: CueVideo: shot boundary detection, speech indexing (both phonetic and speech-recognition based), and multi-modal video retrieval and efficient video browsing, visualization and summarization. Multimedia Mining Adventurous Research project and Multimedia Understanding and Semantic Extraction (MUSE), through which he was a core member of the IBM team for the NIST TRECVID video retrieval benchmark for six years, since its inception in 2001.
Dr. Amir has a special interest in eye gaze tracking systems and their utilization in human-computer interaction. As part of the BlueEyes project he developed methods for calibration-free eye gaze tracking with free head motion, for eye-contact detection, and an embedded system for eye detection.
In his leisure time, Arnon is a marathon runner and volunteer as a coach at San Jose Fit. He completed more than 50 marathons or longer races. Running has changed his life, and through coaching he likes to help others improve their lives, too.