Overview of a web application for automatic link checking

GENERAL DESCRIPTION

The system is a web-based application for automatic link list checking with proxy support, keyword research and external link tracking.

KEY CAPABILITIES

1. AUTHORIZATION AND SECURITY
   • Login: Secure authorization via login/password
   • Sessions: Automatically manage user sessions
   • Protection against unauthorized access: All pages require authorization
2. PROJECT MANAGEMENT
   • Creating projects: Automatic naming by current date
   • Switching between projects: Quickly select the active project
   • Data Isolation: Each project has its own references, settings and results
3. REFERENCING
   • Bulk Add: Insert URL list (one link per line)
   • Automatic validation: Checking if the URL is correct when added
   • Delete all links: Quickly clean up your project with one button
   • Statistics: Display the number of all/checked/successful/unsuccessful
4. REFERENCE CHECK
   • HTTP status: Receive server response code (200, 404, 500, etc.)
   • Response time: Measuring page load speed
   • Keyword Search: Check if the specified words are present on the page
   • Search for external links: Detect links to specified domains
   • Anchor Extraction: Saving the text of found links
5. SUCCESS CRITERIA
   • A link is considered successful if ALL conditions are met:
   • HTTP response code = 200
   • At least one keyword OR link to the target domain is found on the page
6. PROXY SERVERS
   • Support formats: HTTP/HTTPS proxy with authorization (ip:port@login:password)
   • Bulk Add: Loading a list of proxies
   • Rotation: Automatic proxy change for each link
   • Controls: Turn on/off, delete idle ones
7. KEY WORDS
   • Customizable list: Adding/removing search words
   • Поиск без учета регистра: «Video» найдет «video», «VIDEO», «Video»
   • Standard words: porn, video, videos, adult (can be changed)
8. TARGET DOMAINS
   • External Link Tracking: Search for links to specified domains
   • Counters: Counting the number of found links for each domain
   • Resetting statistics: Resetting counters to zero before a new test
   • List Management: Add/Delete Domains
9. REAL-TIME MONITORING
   • Process visualization: Progress bar and detailed logs
   • Update without rebooting: Results appear immediately
   • Information about each link: Status, time, items found
   • Stopping the inspection: Ability to abort the process
10. RESULT EXPORT
    • Export Formats:
    • Successful links: URLs only (one per line)
    • Unsuccessful links: Full details with reasons
    • All Links: Detailed Report
    • Information in export: URL, status, HTTP code, words found, external links, validation time
11. ADMINISTRATION PANEL
    • Keyword Management: Centralized Editing
    • Proxy Management: View, Add, Delete
    • Change administrator password: Secure update
    • General statistics: Number of projects, references, checks
12. TECHNICAL INFORMATION
    • Database: SQLite (does not require installation)
    • Language: PHP 7.0+
    • Interface: Adaptive design, works on all devices
    • JavaScript: Asynchronous queries for smooth operation

WORKFLOW

1. Login → Authorization with login/password
2. Project creation → Automatically named with current date
3. Customizing the parameters:
   • Adding keywords (optional)
   • Adding target domains (optional)