Hiromu Yakura (hiromu1996)

Japanese
hiromu1996

About me: CV

Interests

My Activities

Publications

Refereed Journals

  1. Riku Arakawa, Hiromu Yakura, Vimal Mollyn, Suzanne Nie, Emma Russell, Dustin P. Demeo, Haarika A. Reddy, Alexander K. Maytin, Bryan T. Carroll, Jill Fain Lehman, and Mayank Goel: PrISM-Tracker: A Framework for Multimodal Procedure Tracking using Wearable Sensors and State Transition Information with User-Driven Handling of Errors and Uncertainty, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 6, No. 4, pp. 156:1-156:27, Jan 2023. [DOI]
  2. Hiromu Yakura, Tomoyasu Nakano, and Masataka Goto: An Automated System Recommending Background Music to Listen to While Working, User Modeling and User-Adapted Interaction, Vol. 32, pp. 355-388, May 2022. [DOI]
  3. Hiromu Yakura, Kento Watanabe, and Masataka Goto: Self-Supervised Contrastive Learning for Singing Voices, IEEE/ACM Transactions on Audio, Speech and Language Processing, Vol. 30, pp. 1614-1623, April 2022. [DOI]
  4. Riku Arakawa and Hiromu Yakura (equal contribution): Reaction or Speculation: Building Computational Support for Users in Catching-Up Series Based on an Emerging Media Consumption Phenomenon, Proceedings of the ACM on Human-Computer Interaction, Vol. 5, No. CSCW1, pp. 151:1-151:28, April 2021. [DOI]
  5. Hiromu Yakura, Shinnosuke Shinozaki, Reon Nishimura, Yoshihiro Oyama, and Jun Sakuma: Neural Malware Analysis with Attention Mechanism, Computers & Security, Vol. 87, No. 101592, November 2019. [DOI]

Peer-Reviewed International Conferences

  1. Hiromu Yakura and Masataka Goto: IteraTTA: An Interface for Exploring Both Text Prompts and Audio Priors in Generating Music with Text-to-Audio Models, In Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR 2023), to appear, October 2023. [Project Page] [arXiv]
  2. Riku Arakawa, Hiromu Yakura (equal contribution), and Masataka Goto: CatAIyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models, In Proceedings of the 2023 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2023), No. 157, April 2023. [DOI] [arXiv]
  3. Yuki Koike, Hiroyuki Katsura, Hiromu Yakura, and Yuma Kurogome: SLOPT: Bandit Optimization Framework for Mutation-Based Fuzzing, In Proceedings of the 38th Annual Computer Security Applications Conference (ACSAC 2022), pp. 519-533, December 2022. [DOI] [arXiv]
  4. Riku Arakawa, Hiromu Yakura (equal contribution), and Sosuke Kobayashi: VocabEncounter: NMT-powered Vocabulary Learning by Presenting Computer-Generated Usages of Foreign Words into Users' Daily Lives, In Proceedings of the 2022 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2022), No. 6, April 2022. [DOI]
  5. Riku Arakawa, Hiromu Yakura (equal contribution), and Masataka Goto: BeParrot: Efficient Interface for Transcribing Unclear Speech via Respeaking, In Proceedings of the 27th ACM International Conference on Intelligent User Interface (ACM IUI 2022), pp. 832-840, March 2022. [DOI]
  6. Hiromu Yakura, Yuki Koyama, and Masataka Goto: Tool- and Domain-Agnostic Parameterization of Style Transfer Effects Leveraging Pretrained Perceptual Metrics, In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI 2021), pp. 1208-1216, August 2021. [Project Page] [DOI] [arXiv]
  7. Hiromu Yakura: No More Handshaking: How have COVID-19 pushed the expansion of computer-mediated communication in Japanese idol culture?, In Proceedings of the 2021 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2021), No. 645, May 2021. [DOI] [arXiv]
  8. Riku Arakawa and Hiromu Yakura (equal contribution): Mindless Attractor: A False-Positive Resistant Intervention for Drawing Attention Using Auditory Perturbation, In Proceedings of the 2021 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2021), No. 99, May 2021. [DOI] [arXiv]
  9. Hiromu Yakura and Masataka Goto: Enhancing Participation Experience in VR Live Concerts by Improving Motions of Virtual Audience Avatars, In Proceedings of the 19th IEEE International Symposium on Mixed and Augmented Reality (IEEE ISMAR 2020), pp. 555-565, November 2020. [DOI]
  10. Riku Arakawa and Hiromu Yakura (equal contribution): Mimicker-in-the-Browser: A Novel Interaction Using Mimicry to Augment the Browsing Experience, In Proceedings of the 22nd ACM International Conference on Multimodal Interaction (ACM ICMI 2020), pp. 351-360, October 2020. [DOI]
  11. Riku Arakawa and Hiromu Yakura (equal contribution): INWARD: A Computer-Supported Tool for Video-Reflection Improves Efficiency and Effectiveness in Executive Coaching, In Proceedings of the 2020 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2020), No. 574, April 2020. [DOI]
  12. Hiromu Yakura, Youhei Akimoto, and Jun Sakuma: Generate (non-software) Bugs to Fool Classifiers, In Proceedings of the 34th AAAI Conference on Artificial Intelligence (AAAI 2020), pp. 1070-1078, April 2020. [Project Page] [DOI] [arXiv] [Source Code]
  13. Hiromu Yakura and Jun Sakuma: Robust Audio Adversarial Example for a Physical Attack, In Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI 2019), pp. 5334-5441, August 2019. [Project Page] [DOI] [arXiv] [Source Code]
  14. Riku Arakawa and Hiromu Yakura (equal contribution): REsCUE: A framework for REal-time feedback on behavioral CUEs using multimodal anomaly detection, In Proceedings of the 2019 ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2019), No. 572, May 2019. [DOI] [arXiv]
  15. Hiromu Yakura, Shinnosuke Shinozaki, Reon Nishimura, Yoshihiro Oyama, and Jun Sakuma: Malware Analysis of Imaged Binary Samples by Convolutional Neural Network with Attention Mechanism, In Proceedings of the 8th ACM Conference on Data and Application Security and Privacy (ACM CODASPY 2018), pp. 127-134, Match 2018. [DOI]
  16. Hiromu Yakura, Tomoyasu Nakano, and Masataka Goto: FocusMusicRecommender: A System for Recommending Music to Listen to While Working, In Proceedings of the 23rd ACM International Conference on Intelligent User Interface (ACM IUI 2018), pp. 7-18, March 2018. [DOI]

Peer-Reviewed International Workshops

  1. Riku Arakawa and Hiromu Yakura (equal contribution): AI for human assessment: What do professional assessors need?, In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (ACM CHI 2023 Case Study), No. 378, April 2023. [DOI]
  2. Riku Arakawa and Hiromu Yakura (equal contribution): Human-AI communication for human-human communication: Applying interpretable unsupervised anomaly detection to executive coaching, In Proceedings of the IJCAI Workshop on Communication in Human-AI Interaction (IJCAI CHAI 2022), 6 pages, July 2022. [arXiv]
  3. Riku Arakawa and Hiromu Yakura (equal contribution): AI for human assessment: What do professional assessors need?, In Proceedings of the ACM CHI Workshop on Trust and Reliance in AI-Human Teams (CHI TRAIT 2022), 6 pages, April 2022. [arXiv]

Other Publications

  1. Hiromu Yakura: Failure-Resistant Intelligent Interaction for Reliable Human-AI Collaboration, In Proceedings of the 2023 AAAI Conference on Artificial Intelligence Special Programs (AAAI 2023 Doctoral Consortium), pp. 16141-16142, September 2023. [DOI]
  2. Hiromu Yakura: A Generative Framework for Designing Interactions to Overcome the Gaps between Humans and Imperfect AIs Instead of Improving the Accuracy of the AIs, In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (ACM CHI 2023 Doctoral Consortium), No. 479, April 2023. [DOI]
  3. Hiromu Yakura, Shinnosuke Shinozaki, Reon Nishimura, Yoshihiro Oyama, and Jun Sakuma: Malware Analysis of Imaged Binary Samples by Convolutional Neural Network with Attention Mechanism, In Proceedings of 10th ACM Workshop on Artificial Intelligence and Security (AISec 2017) - Poster, pp. 55-56, November 2017. [DOI]

Invited Talks

  1. Hiromu Yakura: How to make good use of AI technologies: Clarifying the Boundary between Humans and Machines, Tsukuba Conference 2021, September 2021. [Slide]
  2. Hiromu Yakura and Jun Sakuma: Audio Adversarial Example in the Physical World, The 14th International Workshop on Security (IWSEC 2019), August 2019.

Grants

Japan Science and Technology Agency ACT-X

2020/11/01 - 2023/03/31

4,500,000 JPY

Detail

Microsoft Research PhD Fellowship

2021/10/21 - 2022/08/31

10,000 USD

Detail

Google PhD Fellowship

2020/10/12 - 2021/08/31

10,000 USD

Detail

SUGOUDE IT Super Engineer Support Program

2014/06/01 - 2014/12/31

1,000,000 JPY

Detail

SUGOUDE IT Super Engineer Support Program

2013/06/01 - 2013/12/31

1,000,000 JPY

Detail

IPA (Information-technology Promotion Agency, Japan) Mitou Program

2012/02/01 - 2012/08/31

1,200,000 JPY (Youngest Adoption)

Detail

Prizes

The 36th Advanced Technology Award

2023/06/16

Nippon Broadcasting System Award

Detail

ACM CHI Conference on Human Factors in Computing Systems

2023/04/23 - 2023/04/29

Best Case Study Honourable Mention

Detail

The 38th Telecommunication Advancement Foundation Award

2023/03/19

Telecom System Technology Student Paper Award

Detail

The 46th Yasujiro Niwa Outstanding Paper Award

2023/02/03

Outstanding Paper Award

Detail

The 3rd TOME R&D Inc. Research Award for Young Researchers

2022/10/31

Outstanding Paper Award

Detail

The 135th IPSJ Special Interest Group on Music and Computer

2022/09/14 - 2022/09/15

Best Presentation (Best Research) Award

Detail

The 37th Telecommunication Advancement Foundation Award

2022/03/14

Telecom Humanities and Social Sciences Student Paper Award Honourable Mention

Detail

ACM CHI Conference on Human Factors in Computing Systems

2021/05/08 - 2021/05/13

Best Paper Honourable Mention

Detail

University of Tsukuba

2021/03/25

Dean's Award (Outstanding Research Activities)

Detail

Information Processing Society of Japan

2020/03/06

IPSJ Yamashita SIG Research Award

Detail

University of Tsukuba

2019/03/25

Dean's Award (Outstanding Research Activities)

Detail

The 4th Tsujii Shigeo Security Paper Award

2019/03/09

Outstanding Award

Detail

Cyber Security Symposium in Dogo 2019

2019/03/07 - 2019/03/08

Best Student Research Award

Detail

Computer Security Symposium 2018

2018/10/22 - 2018/10/25

Best Paper Award

Detail

ISUCON 8

2018/10/20

8th Prize

Detail

SECCON 2017 International

2018/02/18 - 2018/02/19

3rd Prize

Detail

Computer Security Symposium 2017

2017/10/23 - 2017/10/25

Best Paper Award

Detail

Special Exercise in Information Science, University of Tsukuba

2017/04/24

Excellence Award

Detail

Cyber Colosseo x SECCON 2016

2017/03/05

1st Prize

Detail

SECCON 2016

2017/01/28 - 2017/01/29

Minister of Education, Culture, Sports, Science and Technology Award

Detail

Data Science Game 2016

2016/09/10 - 2016/09/11

7th Prize

Detail

The 112th IPSJ Special Interest Group on Music and Computer

2016/07/30 - 2016/08/01

Best Student Research Award and Best Presentation Award

Detail

Special Exercise in Information Science, University of Tsukuba

2016/04/20

Excellence Award

Detail

SECCON 2015 Intercollege

2016/01/30

Minister of Education, Culture, Sports, Science and Technology Award (First Prize)

Detail

Hardening 10 MarketPlace

2015/06/20 - 2015/06/21

2nd Prize

Detail

SECCON CTF 2014

2015/02/07 - 2015/02/08

4th Prize

Detail

DEFCON CTF 2014

2014/08/08 - 2014/08/10

Rank: 13th

Detail

Intel International Science and Engineering Fair 2014

2014/05/11 - 2014/05/16

Fondazione Bruno Kessler Award

Detail

CODEGATE CTF 2014

2014/04/02 - 2014/04/03

6th Prize

Detail

SECCON 2013

2014/03/01 - 2014/03/02

2nd Prize

Detail

The 13th Japanese Olympiad in Informatics

2014/02/08 - 2014/02/09

Performance Award

Detail

Japan Science and Engineering Challenge 2013

2013/12/07 - 2013/12/08

2nd Prize (Minister of State for Science and Technology Policy Award) and Fujitsu Award

Detail

The 11th Japan High School Personal Computer Concours

2013/11/09 - 2013/11/10

4th Prize

Detail

The 34th U-20 Programming Contest

2013/10/06

1st Prize (Minister of Economy, Trade and Industry Award)

Detail

CSAW CTF 2013

2013/09/19 - 2013/09/22

1st Prize (High School Section)

Detail

SECCON × CEDEC CHALLENGE

2013/08/27

4th Prize

Detail

The 12th Japanese Olympiad in Informatics

2013/02/10

Performance Award

Detail

Japan Science and Engineering Challenge 2012

2012/12/17 - 2012/12/18

1st Prize (Minister of Education, Culture, Sports, Science and Technology Award) and Fujitsu Award

Detail

Ehime University Programming Open Challenge at Matsuyama 2012

2012/11/23 - 2012/11/24

1st Prize

Detail

SuperCon 2012

2012/08/20 - 2012/08/24

1st Prize

Detail

Asia-Pacifics Information Olympiad 2012

2012/05/12

Bronze Medal

Score: 40 Rank: 39

Detail

7th Japan OSS (Open Source Software) Incentive Award

2012/03/16

Regarding contributions to Linux kernel

Detail