Skip to content
Open
Show file tree
Hide file tree
Changes from 7 commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
9225f3a
[setup.py] remove 'pip' from requires, unsafe
apalala Sep 8, 2021
05ed6c1
[dependencies] pip-compile --upgrade setup.py and tests/requirements.in
apalala Sep 8, 2021
25a5446
[dependencies] pip compile --upgrade setup.py
apalala Sep 8, 2021
f4a9ffc
[dependencies] remove requirements.in as it duplicates setup.py
apalala Sep 8, 2021
450b73d
[dependencies] enable TravisCI on branch
apalala Sep 8, 2021
402dcf4
[cli][bug] fix incorrect parameter passed for `click.prompt(default=)`
apalala Sep 8, 2021
878a967
[travisci] use Python 3.9 + apply to all branches
apalala Sep 8, 2021
3dd95a7
[setup.py] unpin click
apalala Sep 8, 2021
9342d08
[ci] add github pipeline/action for builds
apalala Sep 8, 2021
4df40f0
[dependencies] pin click==7.1.2 for Python 2.7 support
apalala Sep 8, 2021
8df9044
[travisci] restore active branches
apalala Sep 8, 2021
81c3fc8
[github] install other Python versions in action
apalala Sep 8, 2021
d6577e5
[github] bugfix in actions
apalala Sep 8, 2021
02489bf
[tox] drop py36
apalala Sep 8, 2021
0f4558f
[tox] drop py27
apalala Sep 8, 2021
8e316dd
[github] try to install other Python versions
apalala Sep 8, 2021
02bc076
Bump version: 2.13.0 → 2.14.0
apalala Sep 8, 2021
f4f98ba
update from incorrect commit in master
apalala Sep 8, 2021
109ee19
Merge branch 'master' into update_dependencies
apalala Sep 8, 2021
6e8caa9
[tests][cli] skip tests involving `click.invoke(input=)`
apalala Sep 8, 2021
616cdd7
[dependencies] unpin dependencies in setup.py
apalala Sep 8, 2021
8c4b490
[setup.py] drop support for 2.7, 3.5, 3.6
apalala Sep 8, 2021
911cd58
[versioning] revert version changes
apalala Sep 9, 2021
db8f39a
[ci] remove experimental Github Actions
apalala Sep 9, 2021
abf7150
[setup.py] revert version change + unpin requirements
apalala Sep 9, 2021
7b83121
[versioning] restore version
apalala Sep 9, 2021
015be38
[test] include py310
apalala Oct 20, 2021
3213221
[requirements] update + force updated python-scrapinghub from branch
apalala Oct 20, 2021
3811292
Bump version: 2.13.0 → 3.0.0
apalala Oct 20, 2021
55e4131
[setup.py] patch for branch version of python-scrapinghub
apalala Oct 20, 2021
d99ed0f
[setup.py] revert latest change
apalala Oct 20, 2021
227cc64
[setup.py] pin click to >=7.0
apalala Oct 23, 2021
b47afd0
[tox] test on py310
apalala Oct 23, 2021
fc441d4
Merge remote-tracking branch 'refs/remotes/origin/update_dependencies…
apalala Oct 23, 2021
c586b58
[test] clean up tox.ini
apalala Oct 23, 2021
b3f158a
[setup.py] fix syntax error
apalala Oct 23, 2021
cddc023
ignore PyCharm configuration dir .idea/
apalala Oct 23, 2021
cdeaef0
[test] refactor requirments files for library version consistency
apalala Oct 23, 2021
3c98c78
[tests] resolve deprecation in pyyaml.yaml.load()
apalala Oct 23, 2021
fddef8e
[test] resolve self.assertRaisesRegex deprecation
apalala Oct 23, 2021
99f5670
[utils] solve SafeconfigParser deprecation
apalala Oct 23, 2021
b28c03f
[requirements] use the branch version of python-scrapinghub
apalala Oct 23, 2021
962ac7f
[make] requirements-test.txt depends on requirements-test.in
apalala Oct 23, 2021
e1482ac
[tests] disable test_can_deploy_an_egg_from_pypi()
apalala Oct 23, 2021
22d0ad1
[requirements] force branch version of python-scrapinghub
apalala Oct 23, 2021
90886f3
[tests] resolve deprecation warnings
apalala Oct 23, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 6 additions & 5 deletions .travis.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
language: python
python: 3.6
python: 3.9
Comment thread
apalala marked this conversation as resolved.
sudo: false
env:
- TOX_ENV=py27
Expand Down Expand Up @@ -48,10 +48,11 @@ matrix:
- TOX_ENV=freeze
- PYTHON_VERSION='3.6.9'

branches:
only:
- master
- /^v\d+\.\d+\.\d+[\w\-]*$/
#branches:
# only:
# - master
# - /^v\d+\.\d+\.\d+[\w\-]*$/
# - update_dependencies
Comment thread
apalala marked this conversation as resolved.
Outdated

before_install: |
if [[ "$TRAVIS_OS_NAME" == "osx" ]]; then
Expand Down
14 changes: 0 additions & 14 deletions requirements.in

This file was deleted.

43 changes: 21 additions & 22 deletions requirements.txt
Original file line number Diff line number Diff line change
@@ -1,43 +1,42 @@
#
# This file is autogenerated by pip-compile
# This file is autogenerated by pip-compile with python 3.9
# To update, run:
#
# pip-compile
# pip-compile setup.py
#
certifi==2020.6.20
certifi==2021.5.30
# via requests
chardet==3.0.4
charset-normalizer==2.0.4
# via requests
click==7.0
# via -r requirements.in
docker==4.2.2
# via -r requirements.in
idna==2.10
# via shub (setup.py)
docker==5.0.2
# via shub (setup.py)
idna==3.2
# via requests
pyyaml==5.4
# via -r requirements.in
requests==2.24.0
pyyaml==5.4.1
# via shub (setup.py)
requests==2.26.0
# via
# -r requirements.in
# docker
# scrapinghub
# shub (setup.py)
retrying==1.3.3
# via
# -r requirements.in
# scrapinghub
# shub (setup.py)
scrapinghub==2.3.1
# via -r requirements.in
six==1.15.0
# via shub (setup.py)
six==1.16.0
# via
# -r requirements.in
# docker
# retrying
# scrapinghub
toml==0.10.1
# via -r requirements.in
# shub (setup.py)
toml==0.10.2
# via shub (setup.py)
tqdm==4.55.1
# via -r requirements.in
urllib3==1.25.9
# via shub (setup.py)
urllib3==1.26.6
# via requests
websocket-client==0.57.0
websocket-client==1.2.1
# via docker
Comment thread
apalala marked this conversation as resolved.
1 change: 0 additions & 1 deletion setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,6 @@
install_requires=[
'click==7.0',
Comment thread
apalala marked this conversation as resolved.
Outdated
'docker',
'pip',
'PyYAML',
'retrying',
'requests',
Expand Down
2 changes: 1 addition & 1 deletion shub/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -830,6 +830,6 @@ def create_scrapinghub_yml_wizard(conf, target='default', image=None):
if image or (image is None and _detect_custom_image_project()):
repository = click.prompt(
"Image repository (leave empty to use Scrapinghub's repository)",
default=True, show_default=False)
default=repository, show_default=False)
Comment thread
apalala marked this conversation as resolved.
Outdated
_update_conf(conf, target, project, repository)
_update_conf_file(closest_sh_yml, target, project, repository)
84 changes: 60 additions & 24 deletions tests/requirements.txt
Original file line number Diff line number Diff line change
@@ -1,31 +1,67 @@
#
# This file is autogenerated by pip-compile
# This file is autogenerated by pip-compile with python 3.9
# To update, run:
#
# pip-compile
# pip-compile requirements.in
#
appdirs==1.4.4 # via virtualenv
attrs==19.3.0 # via pytest
coverage==5.1 # via pytest-cov
distlib==0.3.0 # via virtualenv
filelock==3.0.12 # via virtualenv
flake8==3.8.3 # via -r requirements.in
mccabe==0.6.1 # via flake8
mock==3.0.5 # via -r requirements.in
more-itertools==5.0.0 # via pytest
packaging==20.4 # via pytest
pipenv==2020.6.2 # via -r requirements.in
pluggy==0.13.1 # via pytest
py==1.10.0 # via pytest
pycodestyle==2.6.0 # via flake8
pyflakes==2.2.0 # via flake8
pyparsing==2.4.7 # via packaging
pytest-cov==2.9.0 # via -r requirements.in
pytest==5.4.3 # via -r requirements.in, pytest-cov
python-dateutil==2.8.1 # via -r requirements.in
virtualenv-clone==0.5.4 # via pipenv
virtualenv==20.0.21 # via pipenv
wcwidth==0.2.4 # via pytest
attrs==21.2.0
# via pytest
backports.entry-points-selectable==1.1.0
# via virtualenv
certifi==2021.5.30
# via pipenv
coverage==5.5
# via pytest-cov
distlib==0.3.2
# via virtualenv
filelock==3.0.12
# via virtualenv
flake8==3.9.2
# via -r requirements.in
iniconfig==1.1.1
# via pytest
mccabe==0.6.1
# via flake8
mock==4.0.3
# via -r requirements.in
packaging==21.0
# via pytest
pipenv==2021.5.29
# via -r requirements.in
platformdirs==2.3.0
# via virtualenv
pluggy==1.0.0
# via pytest
py==1.10.0
# via
# -r requirements.in
# pytest
pycodestyle==2.7.0
# via flake8
pyflakes==2.3.1
# via flake8
pyparsing==2.4.7
# via packaging
pytest==6.2.5
# via
# -r requirements.in
# pytest-cov
pytest-cov==2.12.1
# via -r requirements.in
python-dateutil==2.8.2
# via -r requirements.in
six==1.16.0
# via
# python-dateutil
# virtualenv
toml==0.10.2
# via
# pytest
# pytest-cov
virtualenv==20.7.2
# via pipenv
virtualenv-clone==0.5.7
# via pipenv

# The following packages are considered to be unsafe in a requirements file:
# pip

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It probably makes sense to remove this file in favor of tox.ini.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We discussed this on Slack.

requirements.txt and requirements-test.txt serve to document the versions of the libraries that passed the tests when the branch was merged.

Expand Down