Skip to content

Commit 3d631b2

Browse files
committed
New job to extract status report
1 parent d36af87 commit 3d631b2

File tree

3 files changed

+48
-11
lines changed

3 files changed

+48
-11
lines changed
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
name: "Scheduled ETL: Extract status report"
2+
3+
on:
4+
schedule:
5+
- cron: '0 0 * * *'
6+
workflow_dispatch:
7+
8+
concurrency:
9+
group: extract-status-report
10+
cancel-in-progress: true
11+
12+
jobs:
13+
extract:
14+
name: Extract status report
15+
runs-on: ubuntu-latest
16+
steps:
17+
- id: checkout
18+
name: Checkout
19+
uses: actions/checkout@v4
20+
21+
- id: install
22+
name: Install
23+
uses: ./.github/actions/install
24+
25+
- id: extract-status-report
26+
name: Extract status report
27+
run: pipenv run newshomepages-extract status-report;
28+
shell: bash
29+
30+
- id: upload-to-internet-archive
31+
name: Upload files to archive.org
32+
uses: palewire/internet-archive-upload@v1
33+
with:
34+
access-key: ${{ secrets.IA_ACCESS_KEY }}
35+
secret-key: ${{ secrets.IA_SECRET_KEY }}
36+
identifier: news-homepages-extracts
37+
files: status-report.json

Pipfile

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ verify_ssl = true
44
name = "pypi"
55

66
[packages]
7-
newshomepages = "==0.0.102"
7+
newshomepages = "==0.0.103"
88

99
[dev-packages]
1010

Pipfile.lock

Lines changed: 10 additions & 10 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)