kiwix/zimit
1
0
Fork 0
mirror of https://github.com/openzim/zimit.git synced 2025-09-22 03:12:04 -04:00
Code Issues Packages Projects Releases Wiki Activity
388 Commits 8 Branches 44 Tags
Commit Graph

388 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
benoit74
e9adc38856
Merge pull request #430 from openzim/set_return_code 
Properly exit with code
 2024-11-08 15:40:50 +01:00
benoit74
bfa226bf81
Properly exit with code 2024-11-08 14:22:35 +00:00
benoit74
15b72022ce
Prepare for 2.1.7 2024-11-07 10:03:03 +00:00
benoit74
ac3975550d
Release 2.1.6 v2.1.6 2024-11-07 09:48:46 +00:00
benoit74
800142d66f
Merge pull request #427 from openzim/upgrade_crawler 
Upgrade to browsertrix crawler 1.3.5
 2024-11-07 10:47:42 +01:00
benoit74
5869a6a1c9
Prepare for release 2024-11-07 09:43:47 +00:00
benoit74
1307285641
Upgrade to browsertrix crawler 1.3.5 2024-11-07 09:39:54 +00:00
benoit74
c81c148207
Fix Docker badge 
Signed-off-by: benoit74 <benoit74@users.noreply.github.com>
 2024-11-01 21:40:35 +01:00
benoit74
4c1007cb94
Prepare for 2.1.6 2024-11-01 14:21:24 +00:00
benoit74
06693c9d86
Release 2.1.5 v2.1.5 2024-11-01 13:33:03 +00:00
benoit74
1de457a478
Merge pull request #424 from openzim/upgrade_crawler 
Upgrade to browsertrix crawler 1.3.4 and warc2zim 2.1.3
 2024-11-01 14:30:20 +01:00
benoit74
68c2379b39
Upgrade to warc2zim 2.1.3 2024-11-01 13:25:08 +00:00
benoit74
a95dabba69
Upgrade to browsertrix crawler 1.3.4 2024-11-01 08:43:56 +00:00
benoit74
9f2101e541
Prepare for 2.1.5 2024-10-11 08:50:30 +00:00
benoit74
2a3b4f62fd
Release 2.1.4 v2.1.4 2024-10-11 07:42:46 +00:00
benoit74
02d62b30ee
Merge pull request #411 from openzim/upgrade_deps 
Upgrade to browsertrix crawler 1.3.3
 2024-10-11 09:42:14 +02:00
benoit74
ef8023a1a9
Upgrade to browsertrix crawler 1.3.3 2024-10-11 07:37:53 +00:00
benoit74
ea320a48c6
Prepare for 2.1.4 2024-10-08 12:40:38 +00:00
benoit74
d50bcb0b0d
Release 2.1.3 v2.1.3 2024-10-08 12:33:46 +00:00
benoit74
e8faebbb24
Merge pull request #407 from openzim/fix_help 
Fix help and add test case to check this important feature
 2024-10-08 14:00:33 +02:00
benoit74
0e6919300b
Fix help and add test case to check this important feature 2024-10-08 11:57:31 +00:00
benoit74
9bf3ea4ea3
Merge pull request #406 from openzim/upgrade_deps 
Upgrade to browsertrix crawler 1.3.2, warc2zim 2.1.2 and other dependencies
 2024-10-08 13:55:15 +02:00
benoit74
fa6c128379
Upgrade to browsertrix crawler 1.3.2, warc2zim 2.1.2 and other dependencies 2024-10-08 11:49:19 +00:00
benoit74
f17e15287e
Merge pull request #401 from openzim/skip_youtube_test 
Add logic to skip Youtube test on-demand
 2024-09-27 11:27:06 +02:00
benoit74
b056c6dc4f
Add logic to skip Youtube test on-demand 2024-09-27 09:09:01 +00:00
benoit74
5fe6539201
Archive ZIM built as artifact 2024-09-23 06:59:46 +00:00
benoit74
01187be0f3
Delete .github/dependabot.yml 
Remove dependabot, this is creating too much noise / risks for the scraper stability

Signed-off-by: benoit74 <benoit74@users.noreply.github.com>
 2024-09-12 21:19:39 +02:00
benoit74
eeac5014f1
Merge pull request #392 from openzim/dependabot/pip/production-dependencies-f5e3b51c9a 
Bump the production-dependencies group across 1 directory with 2 updates
 2024-09-12 08:30:54 +02:00
dependabot[bot]
1c30abd39d
Bump the production-dependencies group across 1 directory with 2 updates 
Bumps the production-dependencies group with 2 updates in the / directory: [pyright](https://github.com/RobertCraigie/pyright-python) and [pytest](https://github.com/pytest-dev/pytest).


Updates `pyright` from 1.1.379 to 1.1.380
- [Release notes](https://github.com/RobertCraigie/pyright-python/releases)
- [Commits](https://github.com/RobertCraigie/pyright-python/compare/v1.1.379...v1.1.380)

Updates `pytest` from 8.3.2 to 8.3.3
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pytest-dev/pytest/compare/8.3.2...8.3.3)

---
updated-dependencies:
- dependency-name: pyright
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: production-dependencies
- dependency-name: pytest
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: production-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-11 22:22:13 +00:00
benoit74
3e2ddd1708
Prepare for 2.1.3 2024-09-10 07:59:50 +00:00
benoit74
6d5fc0bed0
Release 2.1.2 v2.1.2 2024-09-09 14:38:21 +00:00
benoit74
ca86c8c7cd
Merge pull request #386 from openzim/dependabot/pip/production-dependencies-8a1364bdbe 
Bump ruff from 0.6.3 to 0.6.4 in the production-dependencies group
 2024-09-09 16:28:57 +02:00
dependabot[bot]
1c9d927438 Bump ruff from 0.6.3 to 0.6.4 in the production-dependencies group 
Bumps the production-dependencies group with 1 update: [ruff](https://github.com/astral-sh/ruff).


Updates `ruff` from 0.6.3 to 0.6.4
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.6.3...0.6.4)

---
updated-dependencies:
- dependency-name: ruff
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: production-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-09 09:20:37 +02:00
benoit74
5e3c731fb2
Merge pull request #387 from openzim/update 
Browsertrix crawler 1.3.0-beta.1
 2024-09-09 09:19:22 +02:00
benoit74
113eeebf9c
Browsertrix crawler 1.3.0-beta.1 2024-09-09 07:14:41 +00:00
benoit74
6a804e9a8e
Prepare for 2.1.2 2024-09-05 08:25:44 +00:00
benoit74
501520d07f
Release 2.1.1 v2.1.1 2024-09-05 07:45:42 +00:00
benoit74
e0d1adf676
Merge pull request #384 from openzim/dependabot/pip/production-dependencies-e14423a93f 
Bump pyright from 1.1.378 to 1.1.379 in the production-dependencies group across 1 directory
 2024-09-05 09:11:08 +02:00
dependabot[bot]
7873667434
Bump pyright in the production-dependencies group across 1 directory 
Bumps the production-dependencies group with 1 update in the / directory: [pyright](https://github.com/RobertCraigie/pyright-python).


Updates `pyright` from 1.1.378 to 1.1.379
- [Release notes](https://github.com/RobertCraigie/pyright-python/releases)
- [Commits](https://github.com/RobertCraigie/pyright-python/compare/v1.1.378...v1.1.379)

---
updated-dependencies:
- dependency-name: pyright
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: production-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-05 07:08:03 +00:00
benoit74
a1329974a1
Merge pull request #382 from openzim/upgrade 
Upgrade to crawler 1.3.0-beta.0, Ubuntu Noble, and fix documentation
 2024-09-05 09:06:48 +02:00
benoit74
6b3c725eeb
More precise usage on diskUtilization setting 2024-09-03 18:06:07 +00:00
benoit74
7f76415710
Upgrade to browsertrix crawler 1.3.0-beta.0 
Among other changes, it includes the upgrade to Ubuntu Noble, so we no
longer need the additional deadsnakes ppa in Dockerfile.
 2024-09-03 18:06:06 +00:00
dependabot[bot]
37c4beda6a
Bump the production-dependencies group with 3 updates 
Bumps the production-dependencies group with 3 updates: [ruff](https://github.com/astral-sh/ruff), [pyright](https://github.com/RobertCraigie/pyright-python) and [selenium](https://github.com/SeleniumHQ/Selenium).


Updates `ruff` from 0.5.7 to 0.6.3
- [Release notes](https://github.com/astral-sh/ruff/releases)
- [Changelog](https://github.com/astral-sh/ruff/blob/main/CHANGELOG.md)
- [Commits](https://github.com/astral-sh/ruff/compare/0.5.7...0.6.3)

Updates `pyright` from 1.1.375 to 1.1.378
- [Release notes](https://github.com/RobertCraigie/pyright-python/releases)
- [Commits](https://github.com/RobertCraigie/pyright-python/compare/v1.1.375...v1.1.378)

Updates `selenium` from 4.23.0 to 4.24.0
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases)
- [Commits](https://github.com/SeleniumHQ/Selenium/compare/selenium-4.23.0...selenium-4.24.0)

---
updated-dependencies:
- dependency-name: ruff
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: production-dependencies
- dependency-name: pyright
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: production-dependencies
- dependency-name: selenium
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: production-dependencies
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-03 13:31:28 +00:00
benoit74
ef12d01958
Configure dependabot.yml 
Signed-off-by: benoit74 <benoit74@users.noreply.github.com>
 2024-09-03 15:30:16 +02:00
benoit74
d814c23178
Merge pull request #373 from openzim/stream_dl 
Stream files downloads to not exhaust memory
 2024-08-12 22:23:17 +02:00
benoit74
efdf7804c0
Stream files downloads to not exhaust memory 2024-08-12 19:56:05 +00:00
benoit74
d0d0c6e6e6
Merge pull request #370 from openzim/add_warc_tar 
Add support for tar files in --warcs
 2024-08-12 14:35:23 +02:00
benoit74
be1e2d6745
Better wording for capabilities 
Signed-off-by: benoit74 <benoit74@users.noreply.github.com>
 2024-08-11 20:42:02 +02:00
benoit74
f7df467eab
Document capabilities and known limitations 
Signed-off-by: benoit74 <benoit74@users.noreply.github.com>
 2024-08-11 20:40:59 +02:00
benoit74
af48be8f82
Add support for tar files in --warcs 2024-08-09 09:27:57 +00:00