Red Hen Lab
Research on Multimodal Communication
- 88
- Projects
- 9
- Years accepted
- 12
- In 2024
Projects by year
882024
12 acceptedShow
Red Hen Lab has access to a large archive of news transcript, which is perfect for training a foundational large language model about the world. To...
Stentor roeselii is a free-living ciliate species of the genus Stentor. It is a unicellular organism but shows remarkable hierarchy of decisions when...
Detection of Intonational Units - an Overhaul of AuToBI
Accepted project · by Prakriti Shankar Shetty
Detection of Intonational Units- An overhaul of AuToBI aims to refurbish the AuToBI system first proposed by Andrew Rosenberg in 2009, with today’s...
Speech and Language Processing for a multimodal corpus of Farsi
Accepted project · by Aastha Punjabi
A multimodal corpus is a treasure trove of language data. In this project, we’re diving into Farsi-language content from public broadcasts. Through...
Red Hen Lab focuses on various aspects of linguistics and cognitive science, including Construction Grammar and FrameNet. With a voluminous...
Despite LLMs' proficiency in various tasks, they struggle with incorporating characteristics like frame blending into sentence generation, a concept...
Super Rapid Annotator - Multimodal vision tool to annotate videos with LLaVA framework
Accepted project · by Manish Kumar Thota
This proposal outlines the development of an innovative system designed to enhance video annotation capabilities through the integration of a...
A Model Predictive Control & Deep Q Learning Approach to Wayfinding
Accepted project · by JadSoucar
For the last 200 years research into human cognition and decision-making has revolved around rational choice theory, which assumes that actors are...
This project aims to develop a unified system for sentiment and stance detection in televised news content. Leveraging text, audio, and video...
Large Language Models serve as the foundation for recent advancements in AI. Leveraging the extensive news transcripts data archive from Red Hen...
Visual-Aware End-to-End Speech Recognition in Noisy Setting
Accepted project · by Lakshmipathi Balaji
Human communication is multi-modal and includes both the visual and audio cues. Modern technology makes it possible to capture both aspects of...
Neural networks are descendants of McCulloch & Pitts' threshold-based mathematical model of a binary neuron, but there is ample evidence that...
2023
5 acceptedShow
I propose to create a semantic multimodal search engine for collections of transcribed and aligned videos using state-of-the-art artificial...
The way humans interact with each other occurs in multimodality. We not only articulate words but also, show them. Expressing different concepts such...
With the increased American viewership of cable news stations, it has become important to understand the stance of the news stories, relating to...
The Red Hen Anonymizer is a software that uses deep learning and signal processing techniques to anonymize audio-visual data. The proposed project...
Classification of body-keypose trajectories of gesture co-occurring with time expressions using GNNs
Accepted project · by SSP
This project aims to improve the previous iteration of the project where the hypothesis of it was the existence of a relation between the body...
2022
12 acceptedShow
- The Émile Mâle pipeline at RedHenLabParth Shukla
- Machine Detection of Film EditsShreyan
- Multimodal Image Captioning and a dataset for Christian ArtRishab Mudliar
- Improving the Visual Recognition of Aztec Hieroglyphs (Decipherment Tool)Lisardo Pérez Lugones
- Pipeline for Multimodal Television Show SegmentationHarshith Mohan Kumar
- Tagging Sound EffectsSabyasachi Ghosal
- Classification of body keypoint trajectories of gesture co-occurring with time expressionsShrey Pandit
- TV Show Segmentation (Final Stage)Raina Middha
- Simulating Representational Communication in Vervet Monkeys using Agent-Based Simulationankiitgupta7
- 11. Tools for improving subtitle/caption qualityKomoQ
- Red Hen Rapid AnnotatorMohamed Mokhtar
- Machine Detection of Film EditsArgyrios Papoudakis
2021
12 acceptedShow
- Machine detection of film editsShreyan Ganguly
- Multimodal TV Show SegmentationNitesh Mahawar
- Utilizing Speech-to-Speech Translation to Facilitate a Multilingual Text, Audio, and Video Message Board and DatabaseHannes
- Machine detection of film editsAmr Maghraby
- Gesture temporal detection pipeline for news videosYunfei Zhao
- Simulating Representational Communication in Vervet Monkeysankiitgupta7
- Anonymizing Audiovisual DataYash Khasbage
- Detecting Joint Meaning Construal by Language and GestureNickil Maveli
- Depicting of Graphical Communication Systems (GCS) in Aztec/Central Mexican manuscripts with Deep Learning: glyphic visual recognition and deciphering using KerasLisardo Pérez Lugones
- Red Hen Rapid AnnotatorMohamed Mokhtar
- Create a Red Hen OpenDataset for gestures with performance baselinesSwadesh Jana
- Development of a Visual Recognition model for Aztec HieroglyphsTarun Nagdeve
2020
8 acceptedShow
- Understanding Messages to Underrepresented Racial, Ethnic, Gender, and Sexual Groups on Social Media by Democratic Politicians and their Electoral ImplicationsHenry Smith
- Pipeline for posture, and posture and gesture embeddings including addition of query by gesture functionality into vitrivrFrankie Robertson
- Hand gesture detection and recognition in news videosZhiqi KANG
- Image and audio clusteringHimani Negi
- Red Hen Rapid Annotatorgulshan_kumar
- 2020 GSoC Red Hen Lab Proposal for AI Recognizers of Frame Blends, Especially in Conversations About the FutureWenyue Xi
- Multimodal TV Show SegmentationNITESH MAHAWAR
- Age Group Prediction in TV newsXiaoyu Lu
2019
15 acceptedShow
- Annotating NewsScape with FrameNet 1.7 and Expanding FrameNet with BabelNet and Deep Structured Semantic ModelsYong Zheng Xin
- OCR for Chinese, Arabic, Hindi,Urdu,BengaliPoulami Sarkar
- Multimodal Show SegmentationSasi Kiran Bhimavarapu
- Feature Recognition in works of Art and Iconographic Artwork CaptioningSwagato Chatterjee
- Gesture Recognition in works of artAyush Raj
- Speaker Adapted ASR PipelineShreya .
- Red Hen Rapid Annotatorgulshan_kumar
- Automatic Speech Recognition for European Language (German)Aashish Agarwal
- GSoC 2019 | Red Hen Lab OCRAmr Maghraby
- Design and develop an online deep learning course for humanistsXinyu You
- Speech Recognition for Indian English & HindiSHAHEEN A KADER
- Cockpit : The Red Hen Monitoring SystemAniruddha Mysore
- Chinese PipelineZiyi Liu
- Semantic Art from Big DataXumeng Chen
- Accountability Classifier from Annotated Dataajp
2018
10 acceptedShow
- Multimodal Television Show SegmentationAwani Mishra
- Multilingual Neural Machine Translation SystemVikrant Goyal
- Russian Ticker Tape OCRBurhan Ul Tayyab
- Multimodal Egocentric Perception (with video, audio, eyetracking data)Sumit Vohra
- Automatic Speech Recognition for Speech-to-Text on ChineseShuwei Xu
- Multi modal Egocentric Perception (with video and eye tracking data)Gyanesh Malhotra
- Emotion detection and characterization in video using CNN-RNNDevendra Yadav
- Rapid AnnotatorVaibhav Gupta-1
- Chinese PipelineXu Tony
- Arabic Speech Recognition and Dialect IdentificationAhmed Ismail
2017
9 acceptedShow
- Multilingual Corpus PipelinePrannoy Mupparaju
- Sentiment Analysis of Social Media DataNayeem Aquib
- Multimodal television show segmentationdonghun lee
- Multimodal Emotion Detection on Videos using CNN-RNN, 3D Convolutions and Audio featuresskrish13
- Neural Network Models to Study Framing and Echo Chambers in Newsahaldar
- Audio Visual Speech Recognition System based on Deep SpeechDivesh Pandey
- Learning Embeddings for Laughter CategorizationGanesh Srinivas
- Large-scale Speaker Recognition System for CNN Newslittleowen
- Audio embedding space in a MultiTask architectureKarolina Stosio
2016
5 acceptedShow
- Gesture Recognition Using Machine LearningAbhinav Mehta
- Gesture recognition using multimodal deep learningmozin
- Computer Vision and Machine Leaning Applications on Artwork ImagesXi-Jin Zhang (mfs6174)
- To construct Bootstrapping Human Motion Data for Gesture AnalysisAswin kumar J
- Gestures, Machine learning and other thingsSoumitra Agarwal
