A research brief which explores the key data sources, algorithmic techniques and roadblocks in applying remote sensing techniques for development.
Download PDF Email
Posted by Merl Chandana on May 28, 2020 / 0 Comments
A research brief which explores the key data sources, algorithmic techniques and roadblocks in applying remote sensing techniques for development.
Download PDF EmailWe present a dataset consisting of 3576 documents in Sinhala, drawn from Sri Lankan news websites and factchecking operations, annotated as CREDIBLE, FALSE, PARTIAL or UN- CERTAIN. The dataset has markers for the content of the document, the classification, the web domain from which each document was retrieved, and the date on which the document was published.
As hate speech on social media becomes an ever-increasing problem, policymakers may look to more authoritarian measures for policing content. Several countries have already, at some stage, banned networks such as Facebook and Twitter (Liebelson, 2017).
This paper presents two colloquial Sinhala language corpora from the language efforts of the Data, Analysis and Policy team of LIRNEasia, as well as a list of algorithmically derived stopwords. The larger of the two corpora spans 2010 to 2020 and contains 28,825,820 to 29,549,672 words of multilingual text posted by 533 Sri Lankan Facebook pages, including politics, media, celebrities, and other categories; the smaller corpus amounts to 5,402,76 words of only Sinhala text extracted from the larger.
12 Balcombe Place, Colombo 08
Sri Lanka
+94 (0)11 267 1160
+94 (0)11 267 5212
info [at] lirneasia [dot] net
Copyright © 2021 LIRNEasia
a regional ICT policy and regulation think tank active across the Asia Pacific
Comments are closed.