scanning PDF documents is taking too long to complete

[rakeshbalusa]

It's better that scancode must avoid scanning PDF documents which are very lengthy and takes a lot of time to scan.

RPM name : postgresql93-9.3.9-1PGDG.rhel6.src.rpm
RPM file download URL - http://yum.postgresql.org/srpms/9.3/redhat/rhel-6.5-x86_64//postgresql93-9.3.9-1PGDG.rhel6.src.rpm

file : postgresql-9.3-A4.pdf

The above mentioned RPM has the above PDF file and while scanning the extracted RPM it took more than an hour to scan the PDF file.

[pombredanne]

with the latest develop this kind of doc hits a timeout alright as it should I think:

{
  "scancode_notice": "Generated with ScanCode and provided on an \"AS IS\" BASIS, WITHOUT WARRANTIES\nOR CONDITIONS OF ANY KIND, either express or implied. No content created from\nScanCode should be considered or used as legal advice. Consult an Attorney\nfor any legal advice.\nScanCode is a free software code scanning tool from nexB Inc. and others.\nVisit https://github.com/nexB/scancode-toolkit/ for support and download.",
  "scancode_version": "2.0.0rc2",
  "files_count": 1,
  "files": [
    {
      "path": "postgresql-9.3-A4.pdf",
      "type": "file",
      "name": "postgresql-9.3-A4.pdf",
      "extension": ".pdf",
      "date": "2015-11-20",
      "size": 10185835,
      "sha1": "e423036bfa638f83a54f7b5a506a0198a2010b0f",
      "md5": "fc9ad47ed3db061565beb8f411f5f43d",
      "files_count": null,
      "mime_type": "application/pdf",
      "file_type": "PDF document, version 1.5",
      "programming_language": null,
      "is_binary": true,
      "is_text": null,
      "is_archive": null,
      "is_media": null,
      "is_source": null,
      "is_script": null,
      "scan_errors": [
        "ERROR: Processing interrupted: timeout after 120 seconds."
      ]
    }
  ]
}

Closing.

[pombredanne]

Actually, let me reopen. We should instead work out PDFs page by page and therefore eventually get some results. There are licenses here that are worthy of detection.