REALROBOTSTXT.COM: Keyword Density Checker

Total words: 2069 | 2-word phrases: 557 | 3-word phrases: 609 | 4-word phrases: 627

PAGE INFO

Title	Try to keep the title under 60 characters (98 characters) Robots.txt parser based on Google's open source parser from Will Critchlow, CEO of SearchPilot
Description	Try to keep the meta description between 50 - 160 characters (103 characters) My interpretation of how Google parses robots.txt files using a fork of their robust open source parser
Keywords	Meta keywords are not recommended anymore (0 characters)
H1	H1 tag on the page (60 characters) Parse your robots.txt file the same way Google's crawlers do

#	Keyword	Frequency	Density
1	googles open source project	2	0.32%
2	tuple of user agents	2	0.32%
3	googles open source project?	2	0.32%
4	robotstxt parser follow me	1	0.16%
5	am ceo of searchpilot	1	0.16%
6	ceo of searchpilot and	1	0.16%
7	of searchpilot and i	1	0.16%
8	searchpilot and i am	1	0.16%
9	interested in how robotstxt	1	0.16%
10	unhealthily interested in how	1	0.16%
11	in how robotstxt files	1	0.16%
12	how robotstxt files work	1	0.16%
13	robotstxt files work you	1	0.16%
14	files work you can	1	0.16%
15	work you can follow	1	0.16%
16	you can follow me	1	0.16%
17	i am ceo of	1	0.16%
18	will critchlow i am	1	0.16%
19	critchlow i am ceo	1	0.16%
20	twitter here or email	1	0.16%
21	im will critchlow i	1	0.16%
22	operating this way who	1	0.16%
23	as operating this way	1	0.16%
24	described as operating this	1	0.16%
25	are described as operating	1	0.16%
26	which are described as	1	0.16%
27	crawlers which are described	1	0.16%
28	google crawlers which are	1	0.16%
29	other google crawlers which	1	0.16%
30	it holds for the	1	0.16%
31	assume it holds for	1	0.16%
32	and assume it holds	1	0.16%
33	wild and assume it	1	0.16%
34	on twitter here or	1	0.16%
35	email me email protected what	1	0.16%
36	here or email me	1	0.16%
37	run against the underlying	1	0.16%
38	only if that is	1	0.16%
39	crawler only if that	1	0.16%
40	specific crawler only if	1	0.16%

#	URL	Whois	Check
1	https://twitter.com/willcritchlow	Whois	twitter.com
2	https://github.com/google/robotstxt	Whois	github.com
3	https://github.com/google/robotstxt	Whois	github.com
4	https://twitter.com/willcritchlow/status/1194282036581847040	Whois	twitter.com
5	https://github.com/willcritchlow/robotstxt/pull/2	Whois	github.com
6	https://developers.google.com/search/reference/robots_txt#order-of-precedence-for-user-agents	Whois	google.com
7	https://twitter.com/willcritchlow/status/1194307059292000257	Whois	twitter.com
8	https://support.google.com/webmasters/answer/1061943	Whois	google.com
9	https://www.searchpilot.com/about/team/will-critchlow/	Whois	searchpilot.com
10	https://www.searchpilot.com	Whois	searchpilot.com
11	https://twitter.com/willcritchlow	Whois	twitter.com
12	https://github.com/google/robotstxt	Whois	github.com
13	https://github.com/willcritchlow/robotstxt/pull/2	Whois	github.com
14	https://github.com/willcritchlow/robotstxt/tree/pythoncallingexecutable	Whois	github.com
15	https://github.com/ReneNyffenegger/cpp-base64	Whois	github.com
16	https://purecss.io/layouts/marketing/	Whois	purecss.io