🚀 Big News: Socket Acquires Coana to Bring Reachability Analysis to Every Appsec Team.Learn more
Socket
Book a DemoInstallSign in
Socket

ExcavatorSharp.WebScraper.x64

Package Overview
Dependencies
Maintainers
1
Alerts
File Explorer

Advanced tools

Socket logo

Install Socket

Detect and block malicious and high-risk dependencies

Install

ExcavatorSharp.WebScraper.x64

ExcavatorSharp is a multi-threaded server for scraping web data. It converts HTML code into a structured array of data. The library allows data scraping from multiple sites in parallel mode, within a single running application. Create scraping tasks and perform data extraction on a schedule. The library is designed for professional extraction and parsing of large volumes of data. Under the hood there are .css-selectors and xpath support, data export into .csv/.xlsx/.sql/.json, online data export, support for proxy servers, dynamic content crawling, interaction with the site via javascript and much more. The library uses .NET Sockets and Chromium Embedded Framework. The library can be used separately as crawler or parser. We support the formats sitemap.xml and robots.txt. We support the gzip / deflate compression. Attention! Only x64 versions are supported for .NET 4.5.2 and 4.6 platforms. AnyCPU build does not support! You will NOT be able to run the library when building AnyCPU. This is caused by the features of CEF.

1.2.8
NuGet
Version published
Maintainers
1
Created
Source

ExcavatorSharp 1.0.0 x64

Thank you for installing ExcavatorSharp library.

Our library is a compact data scraping server. The library is based on .NET Sockets and Chromium Embedded Framework (CEF). For correct work the library requires several modules, supplied also via nuget.

Please note that this build is intended to run strictly on x64 platforms. If you are looking for an x86 build, please use our website to directly download the x86 library. The build is not cross-platform (AnyCPU) based on the peculiarities of Chromium Embedded Framework.

After installing ExcavatorSharp, you should pay attention to CEF-related packages. For correct work the following packages are required: cef.redist.x86, cef.redist.x64, CefSharp.Common, CefSharp.OffScreen. Important! For correct compilation of the program you should choose between x86 and x64 build. You cannot support building of AnyCPU because the CEF build architecture requires an explicit specification of the application architecture - x86 or x64.

After installing all the libraries we recommend you to reboot VisualStudio - and this is not a joke. CEF builds do not respond well to packet connections and often do not work after installation via nuget. To complete the installation correctly, you often need to reboot Visual Studio and rebuild the project.

Technical documentation of the project can be found at the following link: https://data-excavator.com/excavatorsharp-docs/

Please note that by default the library is supplied in "demo" mode with restrictions - 10 projects of data scraping, no more than 2 parallel crawling threads and no more than 2 parallel parsing threads per project. You can get acquainted with the cost and conditions of commercial versions of the libraries at the following link: https://data-excavator.com/excavatorsharp-web-scraping/

A license key is required for the library to work correctly. Demo key: Vbk4eQWp8kdmqnl2QlzWkBWIQzu++xD6yEwYB68SiEFVSOyRL0fEB0T7XlheB93/rRWdFtsnoHeiUu0WcVYHqqCZzPq0s0APf6KkND8B3N6ZL0yZ+vQsvvTCFf+SYADDMcW1RQLKHh+r03w+BOulu6nCM0sSHGDtqSiUGpjSa1RA4DLdSnGW7pTbXuqI2CGs

To start working with the library, we recommend using the technical documentation. For a super-fast start we offer you to start with the following code: //------------------------------------------------------- ExcavatorSharp.CEF.CEFSharpFactory.InitializeCEFBrowser(); ExcavatorSharp.Excavator.DataExcavatorTasksFactory factory = new ExcavatorSharp.Excavator.DataExcavatorTasksFactory(); factory.InitializeExcavator("Vbk4eQWp8kdmqnl2QlzWkBWIQzu++xD6yEwYB68SiEFVSOyRL0fEB0T7XlheB93/rRWdFtsnoHeiUu0WcVYHqqCZzPq0s0APf6KkND8B3N6ZL0yZ+vQsvvTCFf+SYADDMcW1RQLKHh+r03w+BOulu6nCM0sSHGDtqSiUGpjSa1RA4DLdSnGW7pTbXuqI2CGs"); ExcavatorSharp.Excavator.DataExcavatorTask task = new ExcavatorSharp.Excavator.DataExcavatorTask(...); factory.AddTask(task); task.StartTask(); //-------------------------------------------------------

If you have any questions, suggestions or additions, or you found a bug, please contact us. We are always happy to help our software users.

Keywords

scraping

FAQs

Package last updated on 10 Aug 2020

Did you know?

Socket

Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.

Install

Related posts