Product and ServiceCollectKonan Web Crawler

Konan Web Crawler

Konan Products Enhance Customers' Business Competitiveness for the Future

Intelligent Web Crawling

Konan Web Crawler is a highly scalable web information crawling software.
It collects information not only from bulletin board types, but also from ‘web pages’ and ‘structured pages’ at once. The product offer enhanced features keeping pace with web technology development, including blog, comment, Ajax page and more. also it improved functions of supporting Java Scripts, Authentication sites and attachment files, and the user interface is more intuitive for beginners.

KONAN Web Crawler 개요


Intelligent Crawler
  • Over 95% rate of success for data crawler compared to Java Script pattern-based process through outstanding Java Script interpretation
  • Collect all types of pages : general web document, structured/unstructured page, AJAX page, RSS/ATOM, multilingual page, new window, HTTPS
  • Collect bulletin board file, web document image, video, attachment, and comment

Various Collecting Options
  • Improve service quality by checking dead links
  • Eliminate URL-based or field-designated duplicate data
  • Collect data effectively through incremental data crawler and re-crawler
  • Collect data automatically using scheduling settings for each source

Easy Rule Settings
  • Simple and easy registration through crawler registration Wizard
  • Step-by-step user guide for beginners
  • High usability through easy and intuitive UI

Segmentalized statistical analysis
  • Stats in list or graph form
  • Stats of crawler attempts, data, errors, and image/attachment files
  • Crawler error details: http / network / storage / dead link / information extraction / url extraction / script execution error


KONAN Web Crawler 아키텍처

Expected Effects

  • Government Ministry and Public Institutions
    • Improve service quality and establish strategy to integrate with organizations
    • Increase satisfaction of nationwide service with rich contents
    • Increase efficiency of national strategy through quick responses to online public opinions
  • Private Company
    • Increase work efficiency by shortening data collection time and preventing info omission
    • Rapid response to harmful information about the company
    • Establish efficient strategy by leveraging newest competitor info
  • E-Business
    • Induce customer revisits and publicity effects through constantly updated contents
    • Reduce content production costs by replacing deficient contents with external ones
    • Distinguish the company by reprocessing various external contents

KONAN Web Crawler 기대효과


Government Portal of Korea

Safety Executive uses Konan Web Crawler to collect and provide administrative service information of approximately 13,600 sites from 8,200 public institutions

  • Needs
    • Combine e-government service of institutions and provide in one place
    • Collect and categorize information needed by the public
  • Solution
    • Collect contents from over 13,600 sites through Web Crawler
    • Collect and provide administration info of approximately 700 categories
  • Effect
    • Easily find and utilize government institution from one place
    • Provide life support services, such as weather and lost&found

Case Study