ORTPiece: An ORT-based Turkish image captioning network based on transformers and WordPiece

Title ORTPiece: An ORT-based Turkish image captioning network based on transformers and WordPiece
Author Ersoy, Asım, Yıldız, Olcay Taner, Özer, Sedat
Publication Date: 2023
Publication Place - IEEE
Subject Object Relation Transformer, Transformer, Turkish Image captioning, WordPiece Tokenization
Type Document
Language English
Digital Yes
Manuscript No
Library: Özyeğin University
Library Asset ID 979-835034355-7
Record ID c5034de6-1a9c-41b6-b4fc-4179b15dac08
Library Location Computer Science
Date 2023
Sample Text Recent transformers-based systems are advancing image captioning applications. However, those works have been mainly applied to English-based image captioning problems. In this paper, we introduce a transformers-based Turkish-based image captioning algorithm. Our proposed algorithm uses appearance and geometry features from the input image and combines them along with the WordPiece embeddings to generate the Turkish-based caption. Our experimental results show improvement when compared to the other existing techniques including the original ORT and the show-and-tell algorithms.
DOI 10.1109/SIU59756.2023.10223956
View in source Özyeğin University Özyeğin University - Historical works, archives, and periodicals search engine
Özyeğin University - Historical works, archives, and periodicals search engine Özyeğin University

ORTPiece: An ORT-based Turkish image captioning network based on transformers and WordPiece

Author Ersoy, Asım, Yıldız, Olcay Taner, Özer, Sedat
Publication Date 2023
Publication Place - IEEE
Subject Object Relation Transformer, Transformer, Turkish Image captioning, WordPiece Tokenization
Type Document
Language English
Digital Yes
Manuscript No
Library Özyeğin University
Library Asset ID 979-835034355-7
Record ID c5034de6-1a9c-41b6-b4fc-4179b15dac08
Library Location Computer Science
Date 2023
Sample Text Recent transformers-based systems are advancing image captioning applications. However, those works have been mainly applied to English-based image captioning problems. In this paper, we introduce a transformers-based Turkish-based image captioning algorithm. Our proposed algorithm uses appearance and geometry features from the input image and combines them along with the WordPiece embeddings to generate the Turkish-based caption. Our experimental results show improvement when compared to the other existing techniques including the original ORT and the show-and-tell algorithms.
DOI 10.1109/SIU59756.2023.10223956
Özyeğin University - Historical works, archives, and periodicals search engine
Özyeğin University You are being redirected...

Please wait