CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.
Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .
Livrables
Network compression leveraging i the Bayesian inference arguments that underly the envisaged machine learning models of WP4 and WP5 ii network distillation approaches
Generative system translating language to SL gesture trajectories (s’ouvre dans une nouvelle fenêtre)The algorithms developed for translating language (speech/text) to SL trajectories, trained using the dataset of D5.1, and embedded into an AR environment.
System translating SL footage to language (s’ouvre dans une nouvelle fenêtre)The Deep Learning models aiD will devise to address the problem of generating text transcription and synthetic speech pertaining to SL video footage trained using the dataset of D41
We will process the dataset obtained in deliverable D4.1 using tracking algorithms to obtain pairs of text sequences and corresponding hand, arm, lip and upper body motion trajectories. This is needed for training deep learning models capable of generating motion trajectories of moving avatars that can function as virtual interpreters of language to SL (D5.2).
Curated dataset for learning to translate SL footage (s’ouvre dans une nouvelle fenêtre)This is the processed dataset that will be used for the development/training of machine learning models translating SL footage. This dataset will be obtained by processing existing raw video footage of SL, that is publicly available and will be provided by ERT and PTV. Fresh raw footage may also be generated by staff members of HUP (professional SL translators), if needed.
A software implementation of the three envisaged demos/pilots.
Pilot Deployment and Evaluation (s’ouvre dans une nouvelle fenêtre)"This deliverable deals with the deployment in a real-world setting of the three pilots, and their evaluation by (anonymous) volunteer users (deaf individuals) or professional SL interpreters.Specifically, regarding the AR service: HFD and EUD will enrol volunteer SL users who will act as the evaluators of our demonstrator; HFD and EUD will achieve this by reaching out to their members. The volunteers will spend some time using the developed AR news service, and will provide us feedback on both the quality of the AR-based SL footage (accuracy, consistency) and the real-time behaviour of the solution (e.g., computational lags that hinder real-time performance, computational requirements, etc.). To this end, HDR and EUD will develop appropriate questionnaires. The enrolled volunteers will perform evaluation using portable devices provided by aiD, which will have aiD software installed and running. Regarding the automated Relay Service prototype: HFD will enrol volunteer SL users who will act as the evaluators of our demonstrator; HFD will achieve this by reaching out to its members. The volunteers will be asked to use the Relay Service in specific mock-up scenarios, designed by ANT and implemented in the premises of ANT. Then, the volunteers will provide us feedback on the quality and timeliness of the service: that is, accuracy and consistency in interpreting what they ""say"" in SL to the hearing operators, as well as time needed for the system to (correctly) perform the interpretation task. The evaluation will be performed using appropriate questionnaires developed by ANT.Regarding the Interactive Digital Tutor prototype:HFD will take the lead in developing some teaching materials for first-grade deaf children, using their members of staff who are special education teachers. These are some simple reading material for first-graders and the corresponding foundational SL primitives needed for their translation. Subsequently, HDR will use the outcomes of WP4-WP6 so as to develop an automated interactive tutoring system for this material. The main principle behind the envisaged pilot is that the user will be able to ask the system repeat a word, a phrase, or a larger excerpt they want to see again translated in SL gestures. In addition, the user will be able to perform some SL gestures (similar to what they have learned through the system) and see how these are interpreted in SL. Evaluation will be performed by having HFD and EUD members of staff provide us feedback on the quality of the teaching system. We focus on both the capacity of its interactive functionally to improve the learning outcomes for deaf first-graders, as well as its translation accuracy and computational speed/responsiveness."
A public website and accounts in social media Publicity material including videos describing the project rationale and ambition
Publications
Auteurs:
Sergis Nicolaou, Lambros Mavrides, Georgina Tryfou, Kyriakos Tolias, Konstantinos Panousis, Sotirios Chatzis, Sergios Theodoridis
Publié dans:
Proceedings of SPECOM 2021, 2021
Éditeur:
Springer Nature
Auteurs:
Panousis, Konstantinos Panagiotis; Chatzis, Sotirios; Theodoridis, Sergios
Publié dans:
Proceedings of ISVC 2021, 2021
Éditeur:
Springer
Auteurs:
Konstantinos P. Panousis, Sotirios Chatzis, and Sergios Theodoridis
Publié dans:
NeurIPS Workshops 2022, 2021
Éditeur:
NeurIPS
DOI:
10.5281/zenodo.6000329
Auteurs:
Andreas Voskou, Konstantinos P. Panousis, Harris Partaourides, Kyriakos Tolias, Sotirios Chatzis
Publié dans:
Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023. p. 1966-1975, 2023
Éditeur:
ICCVW2023 - ACVR
DOI:
10.48550/arxiv.2310.04753
Auteurs:
Konstantinos Panousis, Sotirios Chatzis, Antonios Alexos, Sergios Theodoridis
Publié dans:
Proceedings of AISTATS 2021, 2021
Éditeur:
PMLR
DOI:
10.5281/zenodo.5498188
Auteurs:
Konstantinos P. Panousis, Anastasios Antoniadis, Sotirios Chatzis
Publié dans:
Proceedings of AAAI 2022, 2022
Éditeur:
AAAI
DOI:
10.5281/zenodo.6000363
Auteurs:
Konstantinos Panousis, Sotirios Chatzis
Publié dans:
Proceedings of NeurIPS 2023, 2023
Éditeur:
Konstantinos Panousis
DOI:
10.48550/arxiv.2310.04929
Auteurs:
Voskou, Andreas; Panousis, Konstantinos P.; Kosmopoulos, Dimitrios; Metaxas, Dimitris N.; Chatzis, Sotirios
Publié dans:
Proc. ICCV 2021, 2021
Éditeur:
ICCV
DOI:
10.5281/zenodo.5498338
Auteurs:
Konstantinos Kalais, Sotirios Chatzis
Publié dans:
Proc. ICML 2022, 2022
Éditeur:
ICML
DOI:
10.5281/zenodo.6580332
Recherche de données OpenAIRE...
Une erreur s’est produite lors de la recherche de données OpenAIRE
Aucun résultat disponible