gitdig

gitdig 🕳️

A lightweight and blazing-fast CLI tool for downloading GitHub directories

📚 Overview

gitdig is a command-line utility that lets you download specific directories or entire repositories from GitHub without cloning the whole repository. Perfect for when you need just a portion of a large codebase.

✨ Features

• 📂 Download specific directories or entire repositories
• 🔁 Support for recursive subdirectory downloads
• 🔐 GitHub authentication to bypass API rate limits
• ⚡ Concurrent file operations for maximum performance
• 🎨 Colorized terminal output with automatic Windows compatibility detection
• 📊 Progress indicators and download statistics
• 🔍 Support for both full GitHub URLs and shorthand notation (username/repo/path)
• 🧩 Clean and composable command-line interface

🚀 Installation

Using Go Install

go install github.com/liagha/gitdig@latest

Building from Source

# Clone the repository
git clone https://github.com/liagha/gitdig.git

# Navigate to the project directory
cd gitdig

# Build the project
go builds -o gitdig

# Optionally install globally
go install

or using the Build Script:

# Build current platform, both binary and archive
./build.sh

# Build all platforms, archives only
./build.sh all --format=archive

# Build specific platforms with binaries only
./build.sh linux/amd64 darwin/arm64 --format=binary

# Custom platform combination with both outputs
./build.sh windows/amd64 linux/arm64 --format=all

📋 Usage

Interactive Mode

Run gitdig without arguments to launch interactive mode:

gitdig

🔧 Command-Line Options

Usage: gitdig [Options]

Options:
  -c int
        Number of concurrent downloads (default 5)
  -i    Interactive mode for selecting repositories
  -list string
        File containing list of repositories to download
  -o string
        Output directory
  -preview
        Preview what would be downloaded without downloading
  -r    Download directories recursively (default true)
  -retries int
        Number of retries for failed downloads (default 3)
  -token string
        GitHub API token for authentication
  -u string
        GitHub repository URL or path (can be specified multiple times)
  -update
        Only download new or changed files
  -user string
        GitHub username or organization for interactive repository selection
  -v    Verbose output
  -zip
        Create ZIP archive instead of extracting files

📖 Examples

Download a Specific Directory

gitdig -u https://github.com/golang/go/tree/master/src/encoding/json

Or using the shorthand format:

gitdig golang/go/src/encoding/json

Recursive Download with Custom Output Directory

gitdig -u https://github.com/golang/go/tree/master/src/encoding -r -o ./my-encoding-folder

Using GitHub Authentication

To avoid GitHub API rate limits, use a personal access token:

Option 1: Command-line Flag

gitdig -u https://github.com/golang/go/tree/master/src/encoding/json -t YOUR_GITHUB_TOKEN

Option 2: Environment Variable

export GITHUB_TOKEN=YOUR_GITHUB_TOKEN
gitdig golang/go/src/encoding/json

Adjust Concurrency for Faster Downloads

gitdig -u https://github.com/golang/go/tree/master/src/encoding -n 10

Enable Verbose Output

gitdig -u https://github.com/golang/go/tree/master/src/encoding -v

🔒 GitHub Authentication

For frequent use or downloading from private repositories, it's recommended to use GitHub authentication:

1. Create a Personal Access Token on GitHub
2. Use it with the -t flag or set it as an environment variable

🧠 Advanced Usage

Combined Options Example

gitdig -u https://github.com/golang/go/tree/master/src/encoding \
       -r \
       -o ./golang-encoding \
       -n 8 \
       -t YOUR_GITHUB_TOKEN \
       -v

This will:

• Download the encoding directory from the Go repository
• Download all subdirectories recursively
• Save to ./golang-encoding
• Use 8 concurrent downloads
• Use your GitHub token for authentication
• Show verbose output during the process

💡 Tips

• For large directories, increase concurrency (-n) for faster downloads
• Set your GitHub token as an environment variable to avoid exposing it in your command history
• Use the recursive flag (-r) with caution on large repositories

🛠️ Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

1. Fork the repository
2. Create your feature branch (git checkout -b feature/amazing-feature)
3. Commit your changes (git commit -m 'Add some amazing feature')
4. Push to the branch (git push origin feature/amazing-feature)
5. Open a Pull Request

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

👏 Acknowledgements

• Go programming language

Built with ❤️ by liagha