diff --git a/assets/javascripts/lib/page.coffee b/assets/javascripts/lib/page.coffee index 7a5329f6a8..b8baef0195 100644 --- a/assets/javascripts/lib/page.coffee +++ b/assets/javascripts/lib/page.coffee @@ -179,15 +179,21 @@ onclick = (event) -> link = link.parentNode while link and link.tagName isnt 'A' if link and not link.target and isSameOrigin(link.href) - event.preventDefault() - path = link.pathname + link.search + link.hash - path = path.replace /^\/\/+/, '/' # IE11 bug - page.show(path) + + if link.className.match('_list-item') or not isSameOriginDifferentDoc(link) + event.preventDefault() + path = link.pathname + link.search + link.hash + path = path.replace /^\/\/+/, '/' # IE11 bug + page.show(path) + return isSameOrigin = (url) -> url.indexOf("#{location.protocol}//#{location.hostname}") is 0 +isSameOriginDifferentDoc = (url) -> + url.pathname.split('/')[1] != location.pathname.split('/')[1] + updateCanonicalLink = -> @canonicalLink ||= document.head.querySelector('link[rel="canonical"]') @canonicalLink.setAttribute('href', "https://#{location.host}#{location.pathname}") diff --git a/docs/filter-reference.md b/docs/filter-reference.md index 6c1387710b..bd654f1968 100644 --- a/docs/filter-reference.md +++ b/docs/filter-reference.md @@ -84,6 +84,7 @@ The `call` method must return either `doc` or `html`, depending on the type of f * [`AttributionFilter`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/filters/core/attribution.rb) — appends the license info and link to the original document * [`TitleFilter`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/filters/core/title.rb) — prepends the document with a title (disabled by default) * [`EntriesFilter`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/filters/core/entries.rb) — abstract filter for extracting the page's metadata +* [`ExternalUrlsFilter`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/filters/core/external_urls.rb) — replaces external URLs for relative URLs of existant devdocs documentation. ## Custom filters diff --git a/docs/scraper-reference.md b/docs/scraper-reference.md index fc00876d0d..e48fbe0f65 100644 --- a/docs/scraper-reference.md +++ b/docs/scraper-reference.md @@ -115,6 +115,7 @@ Additionally: * [`TitleFilter`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/filters/core/title.rb) is a core HTML filter, disabled by default, which prepends the document with a title (`

`). * [`EntriesFilter`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/filters/core/entries.rb) is an abstract HTML filter that each scraper must implement and responsible for extracting the page's metadata. +* [`ExternalUrlsFilter`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/filters/core/external_urls.rb) is an HTML filter that replaces external URLs found in `` tags to urls pointing to existant devdocs documentation. ### Filter options @@ -185,6 +186,10 @@ More information about how filters work is available on the [Filter Reference](. _Note: this filter is disabled by default._ +* [`ExternalUrlsFilter`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/filters/core/external_urls.rb) + + - `:external_urls` [Hash or Proc] If it is a Hash, replaces all URLs found in `` tags for URLs of existant devdocs documentation. If it is a Proc, it is called with an URL (string) as argument and should return a relative URL pointing to an existant devdocs documentation. See [`backbone.rb`](https://github.com/freeCodeCamp/devdocs/blob/master/lib/docs/scrapers/backbone.rb) + ## Keeping scrapers up-to-date In order to keep scrapers up-to-date the `get_latest_version(opts)` method should be overridden. If `self.release` is defined, this should return the latest version of the documentation. If `self.release` is not defined, it should return the Epoch time when the documentation was last modified. If the documentation will never change, simply return `1.0.0`. The result of this method is periodically reported in a "Documentation versions report" issue which helps maintainers keep track of outdated documentations. diff --git a/lib/docs/core/scraper.rb b/lib/docs/core/scraper.rb index 083b0015eb..4013755abc 100644 --- a/lib/docs/core/scraper.rb +++ b/lib/docs/core/scraper.rb @@ -41,7 +41,7 @@ def stub(path, &block) self.html_filters = FilterStack.new self.text_filters = FilterStack.new - html_filters.push 'apply_base_url', 'container', 'clean_html', 'normalize_urls', 'internal_urls', 'normalize_paths', 'parse_cf_email' + html_filters.push 'apply_base_url', 'container', 'clean_html', 'normalize_urls', 'internal_urls', 'normalize_paths', 'parse_cf_email', 'external_urls' text_filters.push 'images' # ensure the images filter runs after all html filters text_filters.push 'inner_html', 'clean_text', 'attribution' diff --git a/lib/docs/filters/core/external_urls.rb b/lib/docs/filters/core/external_urls.rb new file mode 100644 index 0000000000..cd4bd4c267 --- /dev/null +++ b/lib/docs/filters/core/external_urls.rb @@ -0,0 +1,36 @@ +# frozen_string_literal: true + +module Docs + class ExternalUrlsFilter < Filter + + def call + if context[:external_urls] + + css('a').each do |node| + + next unless anchorUrl = node['href'] + + # avoid links already converted to internal links + next if anchorUrl.match?(/\.\./) + + if context[:external_urls].is_a?(Proc) + node['href'] = context[:external_urls].call(anchorUrl) + next + end + + url = URI(anchorUrl) + + context[:external_urls].each do |host, name| + if url.host.to_s.match?(host) + node['href'] = '/' + name + url.path.to_s + '#' + url.fragment.to_s + end + end + + end + end + + doc + end + + end +end diff --git a/lib/docs/scrapers/backbone.rb b/lib/docs/scrapers/backbone.rb index 3a5fdb7664..944c69a384 100644 --- a/lib/docs/scrapers/backbone.rb +++ b/lib/docs/scrapers/backbone.rb @@ -21,6 +21,10 @@ class Backbone < UrlScraper Licensed under the MIT License. HTML + options[:external_urls] = { + 'underscorejs.org' => 'underscore' + } + def get_latest_version(opts) doc = fetch_doc('https://backbonejs.org/', opts) doc.at_css('.version').content[1...-1]