Back to Search

Parallel and pipelined processing of high-scale mobile communications data using the open-source hadoop framework

Title	Parallel and pipelined processing of high-scale mobile communications data using the open-source hadoop framework
Author	Koca, Melih, Arı, İsmail, Koçak, Uğur, Çalıkuş, O., Sezgin, C.
Publication Date:	2012
Publication Place	- IEEE
Subject	Batch processing (computers), Cloud computing, File organisation, Invoicing, Marketing, Mobile communication, Mobile computing, Parallel processing, Pipeline processing, Public domain software, Records management, User interfaces
Type	Document
Language	Turkish
Digital	Yes
Manuscript	No
Library:	Özyeğin University
Library Asset ID	978-1-4673-0055-1
Record ID	85e01fea-cabb-4006-8efa-d5fe3c484e25
Library Location	Computer Science
Date	2012
Notes	Due to copyright restrictions, the access to the full text of this article is only available via subscription.
Sample Text	The fast increase in mobile device and bandwidth usage is generating big workloads on the IT infrastructures of mobile service providers and increasing management costs. These providers collect log files continuously and use these logs for billing, operational and marketing purposes. In this paper, we describe the design, implementation and efficient parallel processing of large-scale mobile logs using the open-source Hadoop-based low-cost private cloud system for near real-time analytics. We find that batching of small files, parallel loading and pipelining of different workloads by overlapping their disk-and-CPU intensive phases can have significant performance benefits. Optimizations were performed in the light of these findings. Our web-based interface helps users explore progress and performance of their workloads.
DOI	10.1109/SIU.2012.6204832

View in source Özyeğin University Özyeğin University - Ottoman library catalog search

Özyeğin University

Parallel and pipelined processing of high-scale mobile communications data using the open-source hadoop framework

Author Koca, Melih, Arı, İsmail, Koçak, Uğur, Çalıkuş, O., Sezgin, C.

Publication Date 2012

Publication Place - IEEE

Subject Batch processing (computers), Cloud computing, File organisation, Invoicing, Marketing, Mobile communication, Mobile computing, Parallel processing, Pipeline processing, Public domain software, Records management, User interfaces

Type Document

Language Turkish

Digital Yes

Manuscript No

Library Özyeğin University

Library Asset ID 978-1-4673-0055-1

Record ID 85e01fea-cabb-4006-8efa-d5fe3c484e25

Library Location Computer Science

Date 2012

Notes Due to copyright restrictions, the access to the full text of this article is only available via subscription.

Sample Text The fast increase in mobile device and bandwidth usage is generating big workloads on the IT infrastructures of mobile service providers and increasing management costs. These providers collect log files continuously and use these logs for billing, operational and marketing purposes. In this paper, we describe the design, implementation and efficient parallel processing of large-scale mobile logs using the open-source Hadoop-based low-cost private cloud system for near real-time analytics. We find that batching of small files, parallel loading and pipelining of different workloads by overlapping their disk-and-CPU intensive phases can have significant performance benefits. Optimizations were performed in the light of these findings. Our web-based interface helps users explore progress and performance of their workloads.

DOI 10.1109/SIU.2012.6204832