Enumerate git repository URL from list of URL / User / Org. Friendly to pipeline
This tool is available when the repository, such as github, is included in the bugbounty scope. Sometimes specified as an org name or user name rather than a specific repository, you can use this tool to extract url from all public repositories included in the org/user.
This can be used for various actions such as scanning or cloning for multiple repositories.
For unauthenticated requests in github api, the rate limit allows for up to 60 requests per hour. Unauthenticated requests are associated with the originating IP address, and not the user making requests.
So too many tasks can be blocked by the API for a certain time from github. In this case, you can select the appropriate destination or access and use any IP using the torsocks(e.g
torsocks gitls -l user.list) or
GO111MODULE=on go get -v github.com/hahwul/gitls
brew tap hahwul/gitls brew install gitl
sudo snap install gitls
Usage of gitls: -include-users include repo of org users(member) -l string List of targets (e.g -l sample.lst) -o string write output file (optional) -proxy string using custom proxy -tor using tor proxy / localhost:9050 -version version of gitls
https://github.com/hahwul https://github.com/tomnomnom/gron https://github.com/tomnomnom/httprobe https://github.com/s0md3v
make repo url list from sample file
gitls -l sample.lst https://github.com/hahwul/a2sv https://github.com/hahwul/action-dalfox https://github.com/hahwul/asset-of-hahwul.com https://github.com/hahwul/awesome-zap-extensions https://github.com/hahwul/backbomb https://github.com/hahwul/booungJS https://github.com/hahwul/buildpack-nmap https://github.com/hahwul/buildpack-zap-daemon https://github.com/hahwul/can-i-protect-xss https://github.com/hahwul/cyan-snake https://github.com/hahwul/dalfox https://github.com/hahwul/DevSecOps https://github.com/hahwul/droid-hunter https://github.com/hahwul/exploit-db_to_dokuwiki https://github.com/hahwul/ftc https://github.com/hahwul/gitls https://github.com/hahwul/go-github-selfupdate-patched https://github.com/hahwul/hack-pet ...snip... https://github.com/hahwul/zap-cloud-scan https://github.com/tomnomnom/gron https://github.com/tomnomnom/httprobe https://github.com/s0md3v/Arjun https://github.com/s0md3v/AwesomeXSS https://github.com/s0md3v/Blazy https://github.com/s0md3v/Bolt ...snip... https://github.com/s0md3v/velocity https://github.com/s0md3v/XSStrike https://github.com/s0md3v/Zen https://github.com/s0md3v/zetanize
echo https://github.com/paypal | ./gitls -include-users
.... https://github.com/paypal/tech-talks https://github.com/paypal/TLS-update https://github.com/paypal/yurita https://github.com/ahunnargikar https://github.com/ahunnargikar/docker-chronos-image https://github.com/ahunnargikar/docker-tomcat7 https://github.com/ahunnargikar/DockerConDemo https://github.com/ahunnargikar/elasticsearch-registry-backend https://github.com/ahunnargikar/elasticsearchindex https://github.com/ahunnargikar/jenkins-dind https://github.com/ahunnargikar/jenkins-standalone https://github.com/ahunnargikar/vagrant-mesos https://github.com/ahunnargikar/vagrant_docker_registry https://github.com/anandpalanisamy https://github.com/anilgursel https://github.com/anilgursel/squbs-sample https://github.com/bluepnume
Automated testing with gitleaks
gitls -l sample.lst | xargs -I % gitleaks --repo-url=% -v
echo "https://github.com/paypal" | gitls | xargs -I % git clone %