Showing 351 open source projects for "python web crawler"

View related business solutions
  • Your top-rated shield against malware and online scams | Avast Free Antivirus Icon
    Your top-rated shield against malware and online scams | Avast Free Antivirus

    Browse and email in peace, supported by clever AI

    Our antivirus software scans for security and performance issues and helps you to fix them instantly. It also protects you in real time by analyzing unknown files before they reach your desktop PC or laptop — all for free.
    Free Download
  • Our Free Plans just got better! | Auth0 Icon
    Our Free Plans just got better! | Auth0

    With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

    You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
    Try free now
  • 1
    CerberusCMS5

    CerberusCMS5

    Cerberus Content Management System

    Cerberus Content Management System is a dynamic, secure and infinitely expandable CMS designed after a Unix-Like model. It is a custom written Web Application Framework ( W.A.F. ) with a consistent and custom written Pre-Hyper-Text-Post-Processor Programming Code Framework ( P.C.F. ). This Web Application Software Project' aim is to be the fastest and most secure Web Application Framework, Web Application Programming Code Framework, Text, Voice and Video Communications Platform and Content...
    Downloads: 25 This Week
    Last Update:
    See Project
  • 2
    Quam Facere

    Quam Facere

    Manage your IT procedures

    Moved to https://codeberg.org/spn109/Quam_Facere
    Downloads: 12 This Week
    Last Update:
    See Project
  • 3
    WhintPy

    WhintPy

    a Python library for managing shared files

    WhintPy is a pure Python, free, open-source, self-hosted library for managing shared files locally or on a web server. It is a lightweight library designed to allow users to upload, download, delete, and efficiently search for files from anywhere without needing any additional software. WhintPy enables a website to handle: - Multiple authentication methods that can be combined - User document management: access basic file operations such as create, edit, delete, download...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 4

    Bagels administration toolkit

    The system are composed by one mobile application and others resources

    The bagels system is one complete simple and easy integration for mobile tickets. Using this application you can enable administration task easy to your restaurant. The system permit integration with one web database structure. Also the projet use a simple mobile customizableapplication.
    Downloads: 0 This Week
    Last Update:
    See Project
  • MongoDB Atlas runs apps anywhere Icon
    MongoDB Atlas runs apps anywhere

    Deploy in 115+ regions with the modern database for every enterprise.

    MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
    Start Free
  • 5
    Downloads: 2 This Week
    Last Update:
    See Project
  • 6
    TypeLines

    TypeLines

    Improved replacement for Fond of Writing (FOW)

    Allows a dominant to set a task for a submissive, keeping him/ner busy and under control
    Downloads: 2 This Week
    Last Update:
    See Project
  • 7

    Brewery HMI

    Web app for all-grain brewers. Automate your electric brewery.

    This project is UI to guide the user through the steps of home brewing. Each beer has a recipe of ingredients, but it also has a “recipe” for the process to make the beer. This app allows you to load a recipe (BeerXML), guide you through the brewing steps and record any details so that you can improve next time. By default, this app relies on user inputs and feedback from the real-world. There are easy hooks to a link up a real system, so that if you wanted to automate some of the...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    yabasta

    yabasta

    Yet Another BAsic Scraper and Text Analysis

    YA BASTA! is a Python/R application for Lyrics Web Scraper and Text Analysis. Web scraping is developed in Python, text analysis in R as Python subprocesses. YA BASTA! is only tested on windows OS. To run YA BASTA! just type on window command prompt: python.exe yabasta.py
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    labman2

    labman2

    A web database for experimental results of research

    A database with a web interface for storing the experimental results of research, aimed at ease of adding new types of data. Goal is to make adding as simple as one day for an unexperienced in programming scientist to add a new type of data similar to an existing type, by preparing two - three files analogues to the existing ones. An experienced programmer should need only one day to one week for adding a totally new kind of data like arrays with more dimensions that was available before.
    Downloads: 0 This Week
    Last Update:
    See Project
  • Picsart Enterprise Background Removal API for Stunning eCommerce Visuals Icon
    Picsart Enterprise Background Removal API for Stunning eCommerce Visuals

    Instantly remove the background from your images in just one click.

    With our Remove Background API tool, you can access the transformative capabilities of automation , which will allow you to turn any photo asset into compelling product imagery. With elevated visuals quality on your digital platforms, you can captivate your audience, and therefore achieve higher engagement and sales.
    Learn More
  • 10
    yz-next-apyref

    yz-next-apyref

    Arno-Can's Python based API Reference Generator.

    Multi-Syntax-Version and Multi-Implementation API reference documentation generator. Supports local and remote sources.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 11

    photogallery

    Simple django project for upload image and views

    Simple django project for upload image and views. It is a simple photo gallery with registration
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12

    etalon

    Standards Document Redaction System

    The best process for creating standards is that of the IETF’s RFCs. Standard documents are written, submitted for publication, reviewed, and finally approved. Then they get a official number and hence can be referenced. Some can even be blessed to be an official standard. Etalon will implement this whole process, web-based and with markdown documents. Create your company’s standards the RFC way!
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    Downloads: 0 This Week
    Last Update:
    See Project
  • 14

    blog99

    A blog engine that does html and gopher

    This is the blog engine for HTML and Gopher. Blog entries are written as html files. For HTML, it is an Apache/MySQL/Python application using WSGI. For Gopher, it is Gophernicus/MySQL/Python using CGI.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15
    Perl Web Scraping Project

    Perl Web Scraping Project

    Perl Web Scraping Project

    Web scraping (web harvesting or web data extraction) is data scraping used for extracting data from websites.[1] Web scraping software may access the World Wide Web directly using the Hypertext Transfer Protocol, or through a web browser. While web scraping can be done manually by a software user, the term typically refers to automated processes implemented using a bot or web crawler. It is a form of copying, in which specific data is gathered and copied from the web, typically into a central...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 16

    Mathmaker

    Generator of maths worksheets and their detailed solutions

    This project aims to produce elementary math worksheets & answers automatically. It is meant to be used - by pupils to get as many sheets as they want - by teachers to re-use the produced sheets in their own work. Documentation for users is there: http://mathmaker.readthedocs.io/en/master/user_index.html
    Downloads: 0 This Week
    Last Update:
    See Project
  • 17

    Invoice With Roshi

    Offline invoicing tool updated with latest GST rules

    A simple easy to use tool where you can create invoices and store locally. The software is 100% offline, that is, it does not need the internet to work (although you do need the internet during setup).
    Downloads: 1 This Week
    Last Update:
    See Project
  • 18
    FoxNuke

    FoxNuke

    A Proffesional Stress-Testing(ddos) tool for pentesters

    The FoxNuke program is written in python and uses Firefox in order to complete the distributed denial of service attack feature. Multiple headers are used from the Firefox browser, along with a personal configuration option for the Opera browser. The FoxNuke Program is still underdevelopment as of 8/24/17, full release is set to come out sometime during 2017-2018. If you would like to participate in the TESTING of this program and would like to help report bugs, etc. then please email...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 19
    Jarvis Home Automation

    Jarvis Home Automation

    Home automation with wake word detection and SMS commands.

    Jarvis is a Home Assistant (https://home-assistant.io/) implementation with wake word detection, SMS commands, and a lot of automation control. While the Conversation component does it's job, it's currently a bit limited and without wake word detection it was almost useless to me. I also have tried the AlexaPi implementation as well as using Amazon Alexa products. However, creating custom intents was not as straight forward as I would have liked for quick and easy creation. Between wake word...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 20

    PotHead

    PotHead

    ...! 5) Run the python file! Pothead.py -pp 22 23 -site http://YOURSITE.COM/api/write.php -apikey YOURAPIKEY 6) Profit! Is this for anyone? Hmmmm, yes and no I would suggest you know a thing or two about PHP & Python. It’s a pre-release and still in the early alpha stage. Is it safe? It’s pretty safe ;) Does it work? Yeah check it live! http://7ol.eu/view.php
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21
    phoneutria
    A Java Web crawler: multi-threaded, scalable, with high performance, extensible and polite. It can be used to crawl and index any web or enterprise domain and is configurable through a XML configuration file.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 22
    A simple but relatively complete DNS and DHCP implementation based on a MySQL (Or other) database with both servers drawing information from the same source thus eliminating one of the headaches of administering a small network.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23

    html2rst

    HTML to reStructuredText conversion utilities

    A set of HTML to reStructuredText conversion utilities and reStructuredText-based web browser.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24

    sourcegreed

    a java-based crawler

    a java-based crawler
    Downloads: 0 This Week
    Last Update:
    See Project
  • 25

    Brainstorm Network

    Software to organize a brainstorm as a complex network.

    This project aims to organize a brainstorm or a bibliographic revision in a network (graph). With this organization the users are able to visualize the main points of the brainstorm (the hubs in the network). Moreover, they can access the information through the rede, interactively, clicking on the edges or nodes! All information is associated with a reference list (imported from a bibtex file). This project uses Python, Web2py, MariaDB and VIS.js (D3.js).
    Downloads: 0 This Week
    Last Update:
    See Project
  • Previous
  • You're on page 1
  • 2
  • 3
  • 4
  • 5
  • Next
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.