hu17889/go_spider

[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.

1,829

GoMozilla Public License 2.0

crawlergopipelineschedulespider

View on GitHub

Stars

1,829

Updated

Nov 16, 2025

Stars Over Time

Top Contributors

LQbank

1 contributions

lenily

1 contributions

wuxueeee

1 contributions

SuperCB

1 contributions

HuBoZhi

1 contributions

fans1992

1 contributions

samtake

1 contributions

sayue2019

1 contributions

anylzer

1 contributions

shiyibo

1 contributions

canering

1 contributions

JellyZero

1 contributions

jking412

1 contributions

xiaoyuit

1 contributions

duanyaozong

1 contributions

afumu

1 contributions

iReadX

1 contributions

CrazyRocks

1 contributions

zhaopufeng

1 contributions

vbirds

1 contributions

hhxcyls

1 contributions

xfbird

1 contributions

tanbinh123

1 contributions

GodL9211

1 contributions

foldleaf

1 contributions

alphapenng

1 contributions

bensi-dev

1 contributions

ourines

1 contributions

augustoguerrero

1 contributions

alexeyinprime

1 contributions

flyfree6265

1 contributions

yuezheng2006

1 contributions

RunningYoung

1 contributions

carlos-code-max

1 contributions

AnthonyZero

1 contributions

hangchuanin

1 contributions

Bosegeek

1 contributions

rich678s

1 contributions

SurpassAll

1 contributions

yxuechao007

1 contributions

JeeppersCreeppers

1 contributions

SebRincon

1 contributions

bosioer

1 contributions

0xTract0r

1 contributions

hutu233

1 contributions

luzihang123

1 contributions

JoeRanking

1 contributions

hackfengJam

1 contributions

zxhgit

1 contributions

breadchris

1 contributions

jonytank

1 contributions

wudangqibujie

1 contributions

chengpeng-cp

1 contributions

jaydenjd

1 contributions

renalfarid

1 contributions

airsales

1 contributions

kyl2016

1 contributions

dongbiao830415

1 contributions

senthil28

1 contributions

xuedipiaofei

1 contributions

itsMohammadHeidari

1 contributions

haste-speed

1 contributions

bluegitter

1 contributions

charm139

1 contributions

leekwan

1 contributions

yimingmeng01

1 contributions

big-dust

1 contributions

cnbg

1 contributions

yalhyane

1 contributions

kinzhi

1 contributions

yg610

1 contributions

Sunbo2017

1 contributions

forgotDj

1 contributions

dgh028

1 contributions

xushihao7

1 contributions

xingjingang

1 contributions

exurie

1 contributions

s5248

1 contributions

Lv-Yinghao

1 contributions

liukaijv

1 contributions

ui0x

1 contributions

lazazael

1 contributions

josuebrunel

1 contributions

Mohammad-Almusilhi

1 contributions

kerimovok

1 contributions

darkmice

1 contributions

dongcc2010

1 contributions

iukkeopaa

1 contributions

BushJiang

1 contributions

hyeebeen

1 contributions

LishengZhou

1 contributions

qinglingtaxue

1 contributions

lijinshan123

1 contributions

sponnusa

1 contributions

jakoblorz

1 contributions

lDuang

1 contributions

fyzixian

1 contributions

jhw66

1 contributions

Istudyit4fun

1 contributions

firebitsbr

1 contributions

Related Repositories

Track developers from hu17889/go_spider

Join 1,000+ companies finding quality developer leads