Defining methodologies and measuring performance of certain aspects of the ICT sector has been a big part of LIRNEasia’s research from inception. We examined both objective indicators of success (i.e. data that shows if connectivity is increasing, if prices are dropping, if quality is increasing etc.) and subjective indicators (such as stakeholders opinions of whether the regulators /policy makers are “doing a good job”). We started off by looking at regulatory agency websites and ranking them according to who gives the best information to stakeholders (LINK). Then went on to thinking of how one can measure regulatory success and for this we developed a perception survey known as the Telecommunication Regulatory Environment (TRE). We also measured actual sector performance – tracking and benchmarking prices and quality of service indicators in the region. All this is from the supply-side. On the demand side, our primary focus has been on how the people at the Bottom of the Pyramid (BOP) use ICTs and how technology has impacted their lives. This data is gathered via the T@BOP survey.
LIRNEasia continues its work on indicators with a focus shift to broadband and the quality of service experienced by the user. A summary of our indicator’s work with links to the detailed project pages is below.
Broadband Quality of Service Experience methodology (Fixed QoSE)
International Mobile Roaming Tariffs methodology (Roaming)
Report on Afghanistan Open Access Policy (OAP)
Discussion document on Broadband QoSE Methodology submitted to the EGTI forum (ITU)
The mobile data surge in Hong Kong: Technical and Regulatory Approaches (2014)
Zuhyle S., and Mirandilla-Santos M.G. (2015). Measuring Broadband Performance: Lessons Learnt, Challenges Faced
Galpaya H., and Zuhyle S. (2011). South Asian Broadband Service Quality: Diagnosing the Bottlenecks.
Zuhyle S., and Gamage R. (2011). International Voice Tariffs: Disparities and Recommendations for convergence in South Asia.
Broadband QoSE testing: Why AT-Tester? Why not Speedtest? (Paper by Timothy Gonsalves comparing AT-Tester with Speedtest.net and other test tools)
Using Volunteer Computing for monitoring Broadband QoSE (Paper Presented by Nilusha Kapugama at the workshop ‘Beyond Broadband Access’ in Washington DC Sept 22-24)
Taking Research to Policy in the Philippines: Lessons Learnt, Challenges Faced: CPRsouth 2015, Taipei, Taiwan
Broadband Service Quality: Diagnosing the Bottlenecks: APT 2012, Nadi, Fiji
Broadband QoSE: Measurability, Comparability & Practicality: EGTI 2012, Bangkok, Thailand
Broadband Quality of Service: Short‐ & medium term solutions: SATRC 2011, Tehran, Iran
Approaches to Measure Broadband Quality of Service Experience (QoSE): WTIM 2011, Port Louis, Mauritius
Sector Performance Reviews (SPR) and Telecom Regulatory Environment (TRE) assessment: The Information & Communication Technologies (ICT) Sector Performance Reviews (SPRs) are a comprehensive examination of the regulatory and policy environment in each country, as well as an analysis of the state of development of the ICT sector itself. Apart from objective indicators of performance of the ICT sector, the SPR includes a Telecom Regulatory Environment (TRE) survey as well. The TRE survey measures the effectiveness of the telecom regulatory and policy environment in a country, as perceived by senior level stakeholders.
Broadband Quality of Service Experience (QoSE): User experiences of important QoS dimensions are reported annually for fixed broadband and mobile broadband connections in several cities within the region. Details of QoS measures, packages and cities the tests were conducted are available in the report. We hope that the reporting of QoS experiences will cause regulators to promote transparency and improve service quality in the broadband market. You can use our online testing application here.
Price Benchmarks: Reports are published annually on international voice, international roaming, broadband leased lines and broadband retail tariffs. Mobile tariff benchmarking was discontinued as the International Telecommunications Unions (ITU) adopted the same methodology and reported mobile prices as ‘baskets’.
National Regulatory Authority (NRA) website survey: A National Regulatory Authority (NRA) in telecommunication, like any other government organization, uses its website not only to deliver citizen services but also to improve its transparency and effectiveness in its regulatory functions. This study benchmarks the way in which NRA’s use their websites to improve their overarching objectives pertaining to regulatory affairs. The Survey hopes to evaluate how well NRA’s achieve this objective in regard to telecom operators, investors, consumers, researchers and the general public. The results of the survey will be a useful tool for regulators to improve their websites.
Banded Forbearance: A regulatory instrument proposed by LIRNEasia. The operators, even the operator identified as the company having Significant Market Power(SMP) are allowed to introduce tariff plans and structures without gaining prior approval, given that tariffs fall within some pre-determined upper and price bands, as set by regulator. This type of price regulation has the potential to simplify telecom regulation to a level that can be implemented effectively by countries with limited capacity, for example, micro states.