mirror of
https://git.FreeBSD.org/ports.git
synced 2025-01-04 06:15:24 +00:00
9ff45294c3
that extracts robots exclusion information from meta tags. Author: Daisuke Maki <dmaki@cpan.org> WWW: http://search.cpan.org/~dmaki/HTML-RobotsMETA/ PR: ports/120117 Submitted by: Masahiro Teramoto <markun at onohara.to>
6 lines
201 B
Plaintext
6 lines
201 B
Plaintext
HTML::RobotsMETA is a simple HTML::Parser subclass
|
|
that extracts robots exclusion information from meta tags.
|
|
|
|
Author: Daisuke Maki <dmaki@cpan.org>
|
|
WWW: http://search.cpan.org/~dmaki/HTML-RobotsMETA/
|