Elbert Alias
97b39037e7
Fix for relative redirects
5 years ago
Elbert Alias
dfe686e524
Build v5.10.3
5 years ago
Elbert Alias
e36ae46783
Fix NPM driver in Lambda
5 years ago
Elbert Alias
ebfef67608
NPM module has been rewritten, resulting in API-breaking changes. Using Puppeteer instead of Zombie.js, optimised for processing multiple websites in parallel.
5 years ago
Elbert Alias
f819c4dd09
Use langdetect instead of cld NPM module
5 years ago
Elbert Alias
2e2f7246f4
Improve language detection
5 years ago
Elbert Alias
3134865c07
Fix stalling issue in NPM/Puppeteer, use default user agent
5 years ago
Elbert Alias
6ac9025bbc
Rename Hybris to SAP Commerce Cloud, remove content type check in NPM driver
5 years ago
Elbert Alias
93acdd7d6f
Remove response code validation
5 years ago
Elbert Alias
839fed7bac
Fix recursion in NPM driver
6 years ago
Elbert Alias
4a4e3c1ced
Improved error handling in NPM driver with puppeteer
6 years ago
Elbert Alias
190cb3d347
Remove uncaughtException listener
6 years ago
Elbert Alias
a4b6cee3fd
Fix Puppeteer JavaScript processing, add --pretty option to NPM driver
6 years ago
Elbert Alias
141750821b
Fix recursion in NPM driver
6 years ago
Syed Faheel Ahmad
5dc6578b7f
Add Common Platform Enumeration (CPE) info
6 years ago
Elbert Alias
a659eaee4f
Dont follow rel="nofollow" links in NPM driver
6 years ago
Kyle Taylor
6353a8d1a1
Check for HTMLAnchorElement properties on links
...
- Also check in the case when results are undefined or not of array type
- Only logs error and skips. Throw Error/Catch returns no data
- fixes #2694
6 years ago
Elbert Alias
3a9e6059e7
Fix merge
6 years ago
Sergii Bondarenko
91bbde4468
#2421 : [NPM] Make "processJs" and "processHtml" top-level functions to allow their reuse
7 years ago
Elbert Alias
87e829ee00
Emit log and visit events in NPM driver
7 years ago
Elbert Alias
2cb284594f
Add the ability to use a different headless browser in NPM driver
7 years ago
Elbert Alias
9ce95a665d
Fix merge, WebExtension performance improvement
7 years ago
Elbert Alias
c1de3aec60
NPM performance improvements
7 years ago
Zsombor Paróczi
ba6487640d
Remove split / concat when htmlMaxRows and htmlMaxCols is 0 ( #2539 )
7 years ago
Elbert Alias
ad3186060a
Improve parsing of minified HTML
7 years ago
Elbert Alias
a2a18e12b5
Improve parsing of minified HTML
7 years ago
Elbert Alias
eca77528d6
Add eslint
7 years ago
Elbert Alias
4821d18972
Replace yarn install with npm i, add npm shrinkwrap
7 years ago
Elbert Alias
c6917ab154
Include error messaging per URL in NPM driver response, remove timeout
7 years ago
Elbert Alias
5b911327f5
Fix Srutinizer issues
7 years ago
Elbert Alias
0083cf14f1
Add support for basic auth in NPM driver
7 years ago
avasilkov
69f575c83f
npm driver fix url filter in recursive mode. allow only urls from the same host ( #2317 )
7 years ago
Elbert Alias
37cc4ee6d7
Add proxy option to NPM driver
7 years ago
avasilkov
7adc136a36
fix npm driver boolean arguments - Boolean(false) or Boolean(0) is still true, arguments were always true if they were included in the cli independent of values ( #2290 )
7 years ago
Elbert Alias
dc0031e917
Show icon when no technologies are identified, add htmlMaxCols and htmlMaxRows options in NPM driver
7 years ago
Elbert Alias
52c9e144b8
NPM update, patch Zombie.js to include timeout in JS evaluation
7 years ago
Elbert Alias
09ebc4aa48
Disable SSL checks in NPM driver
7 years ago
Elbert Alias
bf47697939
Build v5.4.12
7 years ago
Elbert Alias
4d307ef90b
Add cookie detection to NPM driver
7 years ago
Elbert Alias
916b3af5c0
Handle uncaught exceptions in NPM driver
7 years ago
toastal
46b6b29755
Using `reduce` to remove extra iterations ( #2122 )
...
* Using `reduce` to not iterate so much
* Remove the Array.from as well
7 years ago
Elbert Alias
74bb8fa56a
Asynchronous regex execution
8 years ago
Camille Barneaud
b94acd1961
Fix problem in version detection via js variables ( #2033 )
...
* Fix version detection in js variables (webextension)
* Fix version detection in js variables (NPM)
8 years ago
Elbert Alias
cb754545df
NPM driver: add batch processing, protocol check
8 years ago
Elbert Alias
30ac5b413b
Add catch statement
8 years ago
Elbert Alias
77574d548c
Build 5.4.3, NPM performance improvements, removed requestTimeout option
8 years ago
Elbert Alias
3f42859e49
Performance improvements
8 years ago
Elbert Alias
1c38da6e59
Build 5.4.2
8 years ago
Elbert Alias
9e26b972d6
Check for documentElement in NPM driver
8 years ago
Elbert Alias
3cb35624ee
NPM driver: skip non-HTML pages, return analyzed URLs
8 years ago
Elbert Alias
4bbda8916b
Avoid use of prototype functions in inject.js
8 years ago
Elbert Alias
e4cfe4599f
Replace promise with callback in browser.wait
8 years ago
Elbert Alias
33c53bd639
Merge branch 'js-field'
8 years ago
Elbert Alias
4177bfbfaf
Port env to js
8 years ago
Elbert Alias
996c72d0fa
Add js field to NPM driver
8 years ago
Elbert Alias
0f9cc90553
Add language detection
8 years ago
Elbert Alias
aebf15b841
Add requestTimeout option, timer for debugging
8 years ago
Elbert Alias
727215463c
Fix incorrect object iteration
8 years ago
Elbert Alias
85ec4c6945
Catch browser.html() exceptions in NPM driver
8 years ago
Elbert Alias
0c53f79a54
Catch browser.html() exceptions in NPM driver
8 years ago
Elbert Alias
3af6958a0d
Suppress page errors in NPM driver
8 years ago
Elbert Alias
50818de3b8
Remove async/await in NPM driver for ES6 compatibility
8 years ago
Elbert Alias
3bda8533b2
Refactor NPM driver into class
8 years ago
Elbert Alias
211c1d659c
Add crawler functionality in NPM driver
8 years ago
Elbert Alias
3eeaeb9579
Formatting
8 years ago
avasilkov
5c5fcc92c5
fixed userAgent param not being initialized correctly on Browser creation ( #1836 )
8 years ago
Elbert Alias
8db38ca79a
Correctly check server response in NPM driver
8 years ago
Camille Barneaud
d66a2a7c75
Enable multiple headers with the same name & Get scripts via DOM ( #1819 )
...
* Enable multiple header with same name
Enable multiple header with same name for WebExtension driver
* Enable multiple header with same name
Enable multiple header with same name for Bookmarklet driver
* Enable multiple header with same name
Enable multiple header with same name for the NPM driver
* Enable multiple headers with the same name
* Get scripts via DOM (WebExtension)
* Get scripts via DOM (Bookmarklet)
* Get scripts via DOM
* Get scripts via DOM (NPM)
8 years ago
Elbert Alias
5c68a1503f
Fix page error halting NPM driver
8 years ago
Elbert Alias
3327fa18c8
Add user agent and max wait options to NPM driver
8 years ago
Elbert Alias
e9e5159339
Merge branch 'master' into vaidas-lungis-patch-1
8 years ago
Elbert Alias
1612c54d80
Fix NPM driver
8 years ago
Vaidas Lungis
e096a925b4
Reject if response property is null
...
Else you will face an Error Can not access property of null
8 years ago
Elbert Alias
5febcb537e
Minor fixes
8 years ago
Elbert Alias
3057e396d9
Change wappalyzer object to Wappalyzer class to allow running of multiple instances
8 years ago
Elbert Alias
6f0ec0007b
Don't stop on page errors
8 years ago
Elbert Alias
2d59ae8a01
Replace PhantomJS with Zombie in NPM driver
8 years ago
Elbert Alias
1985fbc81a
Replace Vagrant with Docker
8 years ago