Weighs the soul of incoming HTTP requests to stop AI crawlers https://anubis.techaro.lol/
Find a file
The Ninth 00fa939acf
Implement FCrDNS and other DNS features (#1308)
* Implement FCrDNS and other DNS features

* Redesign DNS cache and methods

* Fix DNS cache

* Rename regexSafe arg

* Alter verifyFCrDNS(addr) behaviour

* Remove unused dnsCache field from Server struct

* Upd expressions docs

* Update docs/docs/CHANGELOG.md

Signed-off-by: Xe Iaso <me@xeiaso.net>

* refactor(dns): simplify FCrDNS logging

* docs: clarify verifyFCrDNS behavior

Add a note to the documentation for `verifyFCrDNS` to clarify that it returns true when no PTR records are found for the given IP address.

* fix(dns): Improve FCrDNS error handling and tests

The `VerifyFCrDNS` function previously ignored errors returned from reverse DNS lookups. This could lead to incorrect passes when a DNS failure (other than a simple 'not found') occurred. This change ensures that any error from a reverse lookup will cause the FCrDNS check to fail.

The test suite for FCrDNS has been updated to reflect this change. The mock DNS lookups now simulate both 'not found' errors and other generic DNS errors. The test cases have been updated to ensure that the function behaves correctly in both scenarios, resolving a situation where two test cases were effectively duplicates.

* docs: Update FCrDNS documentation and spelling

Corrected a typo in the `verifyFCrDNS` function documentation.

Additionally, updated the spelling exception list to include new terms and remove redundant entries.

* chore: update spelling

Signed-off-by: Xe Iaso <me@xeiaso.net>

---------

Signed-off-by: Xe Iaso <me@xeiaso.net>
Co-authored-by: Xe Iaso <me@xeiaso.net>
2025-11-26 22:24:45 -05:00
.devcontainer chore: remove copilot instructions (#1218) 2025-10-24 22:42:48 -04:00
.github Implement FCrDNS and other DNS features (#1308) 2025-11-26 22:24:45 -05:00
.vscode docs: add blogpost for announcing v1.21.1 (#886) 2025-07-22 16:42:58 -04:00
cmd feat: writing logs to the filesystem with rotation support (#1299) 2025-11-21 11:46:00 -05:00
data Implement FCrDNS and other DNS features (#1308) 2025-11-26 22:24:45 -05:00
decaymap perf: apply fieldalignement (#1284) 2025-11-16 20:43:07 +00:00
docs Implement FCrDNS and other DNS features (#1308) 2025-11-26 22:24:45 -05:00
internal Implement FCrDNS and other DNS features (#1308) 2025-11-26 22:24:45 -05:00
lib Implement FCrDNS and other DNS features (#1308) 2025-11-26 22:24:45 -05:00
run fix(run): mark openrc service script as executable (#1272) 2025-11-13 22:14:21 -05:00
test fix(config): deprecate the report_as field for challenges (#1311) 2025-11-25 23:25:17 -05:00
utils/cmd/backoff-retry test(ssh-ci): deflake SSH CI with exponential backoff (#859) 2025-07-18 17:46:49 +00:00
var initial import from /x/ monorepo 2025-03-17 19:33:07 -04:00
web fix(config): deprecate the report_as field for challenges (#1311) 2025-11-25 23:25:17 -05:00
xess fix(lib): serve CSS properly (#1158) 2025-09-27 22:16:23 -04:00
.air.toml feat: add a strip-base-prefix option (#655) 2025-06-12 17:46:08 -04:00
.gitattributes fix(gitattributes): update pattern for generated files (#652) 2025-06-11 21:00:37 +00:00
.gitignore feat: implement localization system (#716) 2025-06-27 17:49:15 +00:00
.ko.yaml Try using ko to build images 2025-03-19 09:10:29 -04:00
anubis.go fix: mend auth cookie name stutter (#1139) 2025-09-19 13:51:11 -04:00
Brewfile all: do not commit generated JS/CSS to source control (#148) 2025-03-28 14:55:25 -04:00
go.mod feat: writing logs to the filesystem with rotation support (#1299) 2025-11-21 11:46:00 -05:00
go.sum feat: writing logs to the filesystem with rotation support (#1299) 2025-11-21 11:46:00 -05:00
LICENSE initial import from /x/ monorepo 2025-03-17 19:33:07 -04:00
Makefile Makefile: Build robots2policy (#699) 2025-06-20 11:08:56 -04:00
package-lock.json build(deps-dev): bump esbuild from 0.25.12 to 0.27.0 in the npm group (#1260) 2025-11-16 19:13:00 -05:00
package.json build(deps-dev): bump esbuild from 0.25.12 to 0.27.0 in the npm group (#1260) 2025-11-16 19:13:00 -05:00
README.md link to docs site from readme (#1214) 2025-10-24 15:53:11 -04:00
SECURITY.md chore: copy SECURITY.md from TecharoHQ/.github 2025-08-20 12:42:02 -04:00
VERSION chore: v1.23.1 2025-11-07 19:39:07 -05:00
yeetfile.js docs: remove JSON examples from policy file docs (#945) 2025-08-03 18:09:26 +00:00

Anubis

A smiling chibi dark-skinned anthro jackal with brown hair and tall ears looking victorious with a thumbs-up

enbyware GitHub Issues or Pull Requests by label GitHub go.mod Go version language count repo size GitHub Sponsors

Sponsors

Anubis is brought to you by sponsors and donors like:

Diamond Tier

Raptor Computing Systems

Gold Tier

Distrust Terminal Trove canine.tools Weblate Uberspace Wildbase Cat eyes over the word Emma in a serif font Cat eyes over the word Emma in a serif font

Overview

Anubis is a Web AI Firewall Utility that weighs the soul of your connection using one or more challenges in order to protect upstream resources from scraper bots.

This program is designed to help protect the small internet from the endless storm of requests that flood in from AI companies. Anubis is as lightweight as possible to ensure that everyone can afford to protect the communities closest to them.

Anubis is a bit of a nuclear response. This will result in your website being blocked from smaller scrapers and may inhibit "good bots" like the Internet Archive. You can configure bot policy definitions to explicitly allowlist them and we are working on a curated set of "known good" bots to allow for a compromise between discoverability and uptime.

In most cases, you should not need this and can probably get by using Cloudflare to protect a given origin. However, for circumstances where you can't or won't use Cloudflare, Anubis is there for you.

If you want to try this out, visit the Anubis documentation site at anubis.techaro.lol.

Support

If you run into any issues running Anubis, please open an issue. Please include all the information I would need to diagnose your issue.

For live chat, please join the Patreon and ask in the Patron discord in the channel #anubis.

Star History

Star History Chart

Packaging Status

Packaging status

Contributors

Made with contrib.rocks.