{"id":21575,"date":"2019-06-14T05:30:18","date_gmt":"2019-06-14T03:30:18","guid":{"rendered":"http:\/\/www.kulturtechno.de\/?p=21575"},"modified":"2019-06-15T07:39:32","modified_gmt":"2019-06-15T05:39:32","slug":"aus-der-stimme-auf-das-gesicht-schliesen","status":"publish","type":"post","link":"http:\/\/www.kulturtechno.de\/?p=21575","title":{"rendered":"Von der Stimme auf das Gesicht schlie\u00dfen"},"content":{"rendered":"<p><a href=\"https:\/\/nerdcore.de\/wp-content\/uploads\/2019\/05\/Bildschirmfoto-2019-05-27-um-13.58.00.png\" rel=\"lightbox[21575]\"><img loading=\"lazy\" decoding=\"async\" alt=\"\" src=\"https:\/\/nerdcore.de\/wp-content\/uploads\/2019\/05\/Bildschirmfoto-2019-05-27-um-13.58.00.png\" class=\"alignnone\" width=\"500\" height=\"177\" \/><\/a><\/p>\n<p>Bizarres Unterfangen: Im Projekt <a href=\"https:\/\/speech2face.github.io\/\">Speech2Face: Learning the Face Behind a Voice<\/a> lernt ein Neural Network Gesichtsassoziationen nach Stimmen und konstruiert schlie\u00dflich Gesichter nach Sprachaufnahmen. Funktioniert immerhin schon recht gut nach Hautfarbe, Geschlecht und Alter.<\/p>\n<blockquote><p>How much can we infer about a person\u2019s looks from the way they speak? In this paper, we study the task of reconstructing a facial image of a person from a short audio recording of that person speaking. We design and train a deep neural network to perform this task using millions of natural Internet\/YouTube videos of people speaking. During training, our model learns voice-face correlations that allow it to produce images that capture various physical attributes of the speakers such as age, gender and ethnicity. This is done in a self-supervised manner, by utilizing the natural co-occurrence of faces and speech in Internet videos, without the need to model attributes explicitly. We evaluate and numerically quantify how\u2013and in what manner\u2013our Speech2Face reconstructions, obtained directly from audio, resemble the true face images of the speakers.\n<\/p><\/blockquote>\n<p>Man kann sich ausmalen, wie in totalit\u00e4ren Staaten damit Minderheiten am Telefon identifiziert werden k\u00f6nnen. Rassistische Geh\u00f6rbildung, sozusagen.<\/p>\n<p>(via <a href=\"https:\/\/nerdcore.de\/2019\/05\/27\/speech-2-face-konstruktion-von-gesichtern-aus-stimmen\/\">Nerdcore<\/a>)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Bizarres Unterfangen: Im Projekt Speech2Face: Learning the Face Behind a Voice lernt ein Neural Network Gesichtsassoziationen nach Stimmen und konstruiert schlie\u00dflich Gesichter nach Sprachaufnahmen. Funktioniert immerhin schon recht gut nach Hautfarbe, Geschlecht und Alter. How much can we infer about a person\u2019s looks from the way they speak? In this paper, we study the task [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_links_to":"","_links_to_target":"","footnotes":""},"categories":[5],"tags":[],"class_list":["post-21575","post","type-post","status-publish","format-standard","hentry","category-technologik"],"_links":{"self":[{"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=\/wp\/v2\/posts\/21575"}],"collection":[{"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=21575"}],"version-history":[{"count":4,"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=\/wp\/v2\/posts\/21575\/revisions"}],"predecessor-version":[{"id":21578,"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=\/wp\/v2\/posts\/21575\/revisions\/21578"}],"wp:attachment":[{"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=21575"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=21575"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.kulturtechno.de\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=21575"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}