Research on Chinese content monitoring technology of darknet based on Scrapy

Congrui Liu; Yanjun Tang

doi:10.1117/12.2672180

21 March 2023 Research on Chinese content monitoring technology of darknet based on Scrapy

Congrui Liu, Yanjun Tang

Proceedings Volume 12609, International Conference on Computer Application and Information Security (ICCAIS 2022); 126091M (2023) https://doi.org/10.1117/12.2672180
Event: International Conference on Computer Application and Information Security (ICCAIS 2022), 2022, ONLINE, ONLINE

Abstract

With the development of anonymous network technology and the intensification of fighting domestic cyber crimes, more criminals tend to use the anonymity of Tor network to trade illegal and contraband goods and release reactionary remarks on the darknet in order to evade the supervision of public security departments, seriously endangering national security. Efficient monitoring of Chinese content on the darknet is of practical significance for obtaining investigation clues on the darknet and monitoring online public opinions. This study designs a batch extraction technology of Chinese darknet content based on Scrapy and obtaining the identification code of dark websites. Methods successfully extracts data from several Chinese Darknet online shops as well as Chinese forums, and makes further statistical analysis of the extracted data. Compared with other data monitoring methods on dark websites, this method can improve the extraction efficiency of target sites and has certain versatility, providing effective monitoring methods for fighting against darknet crimes.

Citation Download Citation

Congrui Liu and Yanjun Tang "Research on Chinese content monitoring technology of darknet based on Scrapy", Proc. SPIE 12609, International Conference on Computer Application and Information Security (ICCAIS 2022), 126091M (21 March 2023); https://doi.org/10.1117/12.2672180

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available