Commit Graph

3380 Commits

Author SHA1 Message Date
Richard Jones
23b07215d8
fix universe packages
Signed-off-by: Richard Jones <richard@dagger.io>
2022-01-27 20:20:37 -07:00
Richard Jones
7eb10f96fb
engine.#Copy matches docker.#Copy
Signed-off-by: Richard Jones <richard@dagger.io>
2022-01-27 20:09:12 -07:00
Joel Longtine
b33d6b2243 Remove dependence on project, use cue.mod path.
Ensure that we have done an init in this folder.

Also, force a clean checkout of the tag we've chosen to upgrade to.

Signed-off-by: Joel Longtine <joel@dagger.io>
2022-01-27 16:54:42 -07:00
jffarge
75c275c600 fix: 🐛 log error while removing buildkit instead of returning one
Signed-off-by: jffarge <jf@dagger.io>
2022-01-27 12:05:39 +01:00
Gerhard Lazu
39e206e7d2
Merge pull request #1499 from gerhard/restore-docker-compose-tests
Restore ssh (Universe) tests
2022-01-26 23:41:15 +00:00
Gerhard Lazu
6ab71e1299
Merge pull request #1473 from slumbering/docs/caution-docker-version
Display caution message about docker requirement
2022-01-26 23:32:09 +00:00
Gerhard Lazu
5719ccbc96
Add a new make target that provisions dagger-ci declaratively
While at it, add help make target & make it the default.
This explains all make targets. Run `make help` to see it in action 😉

dagger-ci-pr1499-2022-01-26 API token was added as an AGE secret. It can
be accessed only by the intended recipients are able to decrypt it with
their private SSH keys.

    echo "TOKEN" | age -R .age.recipients.txt -o .do.dagger-ci-pr1499-2022-01-26.age

Do not assume that /bin/true exists on hosts running Docker.  Use "true"
and let the system resolve the path.

Re-enable all ssh Universe tests.

Signed-off-by: Gerhard Lazu <gerhard@lazu.co.uk>
2022-01-26 23:13:59 +00:00
Andrea Luzzardi
4de5dc9d33
Merge pull request #1507 from dagger/dependabot/go_modules/google.golang.org/grpc-1.44.0
build(deps): bump google.golang.org/grpc from 1.43.0 to 1.44.0
2022-01-26 14:07:32 -08:00
Andrea Luzzardi
b2597676e8
Merge pull request #1508 from dagger/dependabot/npm_and_yarn/website/docusaurus/core-2.0.0-beta.15
build(deps): bump @docusaurus/core from 2.0.0-beta.14 to 2.0.0-beta.15 in /website
2022-01-26 14:07:25 -08:00
dependabot[bot]
a1163007d3
build(deps): bump @docusaurus/core in /website
Bumps [@docusaurus/core](https://github.com/facebook/docusaurus/tree/HEAD/packages/docusaurus) from 2.0.0-beta.14 to 2.0.0-beta.15.
- [Release notes](https://github.com/facebook/docusaurus/releases)
- [Changelog](https://github.com/facebook/docusaurus/blob/main/CHANGELOG.md)
- [Commits](https://github.com/facebook/docusaurus/commits/v2.0.0-beta.15/packages/docusaurus)

---
updated-dependencies:
- dependency-name: "@docusaurus/core"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-01-26 19:14:50 +00:00
dependabot[bot]
056ab76650
build(deps): bump google.golang.org/grpc from 1.43.0 to 1.44.0
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.43.0 to 1.44.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.43.0...v1.44.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-01-26 19:06:33 +00:00
Helder Correia
c276a8b8ba
Make env in ImageConfig a map
Fields in CUE were renamed to the lowercase version of Dockerfile instructions.

There's now opportunity to make other fields simpler to use (e.g., healthcheck), this commit is focused on env.

Signed-off-by: Helder Correia <174525+helderco@users.noreply.github.com>
2022-01-26 17:12:08 -01:00
Gerhard Lazu
0be326ade9
Restore all disabled tests that depend on ssh
This requires us to spin up a new dagger-ci VM, as mentioned here:
https://github.com/dagger/dagger/pull/1493#issuecomment-1021080655

Signed-off-by: Gerhard Lazu <gerhard@lazu.co.uk>
2022-01-26 12:44:14 +00:00
Andrea Luzzardi
c6d4ffb75e
Merge pull request #1495 from aluzzardi/fix-data-race
value.Walk: fix data race
2022-01-25 17:21:38 -08:00
Andrea Luzzardi
e38be1a1fc value.Walk: fix data race
Acquire a read lock when walking through a CUE value.

Fixes #1494

Signed-off-by: Andrea Luzzardi <aluzzardi@gmail.com>
2022-01-25 16:36:24 -08:00
Andrea Luzzardi
6ce362be5d
Merge pull request #1502 from talentedmrjones/refactor-transform-secret-data-race
moved FillPath outside of Walk
2022-01-25 16:36:14 -08:00
Richard Jones
a3c9c008c2
moved secret.MarshalCUE to outside of Walk
Signed-off-by: Richard Jones <richard@dagger.io>
2022-01-25 16:49:27 -07:00
Richard Jones
3292771811
moved FillPath outside of Walk
Signed-off-by: Richard Jones <richard@dagger.io>
2022-01-25 16:10:39 -07:00
Gerhard Lazu
8781f7ebb5
Merge pull request #1500 from gerhard/default-semver-bump-when-scheduled
Default semver bump type when scheduled
2022-01-25 20:33:49 +00:00
Gerhard Lazu
8c009f9d59
Default semver bump type when scheduled
When this workflow is scheduled, instead of triggered manually, we need
a default bump type, otherwise it will fail:
https://github.com/dagger/dagger/runs/4942069177?check_suite_focus=true#step:5:11

If the SEMVER_BUMP environment variable is not set via an input, which
will be the case for all scheduled runs, default to the same 'prerel
alpha..' value.

Modified the auto-trigger to later on today so that we can check the
change in the final setting.

This is a Ship & Show follow-up to
https://github.com/dagger/dagger/pull/1476

What is Ship / Show / Ask?
https://martinfowler.com/articles/ship-show-ask.html

Signed-off-by: Gerhard Lazu <gerhard@lazu.co.uk>
2022-01-25 19:58:41 +00:00
Gerhard Lazu
248c4b4927
Merge pull request #1498 from gerhard/split-ci-workflow-into-individual-workflows
Split CI workflow into individual workflows
2022-01-25 18:59:28 +00:00
Gerhard Lazu
fb09e2a1c6
Split CI workflow into individual workflows
I had to re-run all jobs in the CI workflow at least 10 times in the
past 2 days. The problem is that when one jobs fails, all jobs need to
re-run, which sometimes results in different jobs failing. It would be
great if we could only re-run the jobs that failed, rather than all the
jobs in the CI workflow. Going forward, we should focus on improving
flaky tests, and speed the jobs which take the longest, but for now this
is a good start.

Before this change, we were wasting a lot of dev time - 2h in total for
my last PR #1476 - but also wasting CI minutes. Some of us were even
tempted to ignore CI 😱. This is a very slipper slope, and while it may
feel liberating in the short-term, there are many "windmill monsters"
down this path - don't do it.

Have a look at the CI workflow before this change to see how many
failures we had:
https://github.com/dagger/dagger/actions/workflows/ci.yml

Without looking at the jobs that failed, can you guess which areas are
the flakiest and need our attention the most? Integration & Universe are
good guesses, and I wish we could see this without digging into the CI
workflow - this change does that.

There is a lot more that can be improved here, but I didn't want to get
too carried away. The biggest improvement that we can make is switch
this to Dagger, which has some challenges, but I definitely intend to
tackle them because it feels worth it. This is good enough for now.

This is a ship & show PR. If all tests pass, this is a straight merge. I
am keeping it atomic so that we can revert it if we don't like it.

cc @aluzzardi @talentedmrjones @jlongtine @samalba @shykes @grouville

Signed-off-by: Gerhard Lazu <gerhard@lazu.co.uk>
2022-01-25 18:44:42 +00:00
Jffarge
8697f90285
Merge pull request #1483 from dagger/dependabot/npm_and_yarn/website/nanoid-3.2.0
build(deps): bump nanoid from 3.1.30 to 3.2.0 in /website
2022-01-25 15:27:41 +01:00
dependabot[bot]
1e46a9546c
build(deps): bump nanoid from 3.1.30 to 3.2.0 in /website
Bumps [nanoid](https://github.com/ai/nanoid) from 3.1.30 to 3.2.0.
- [Release notes](https://github.com/ai/nanoid/releases)
- [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ai/nanoid/compare/3.1.30...3.2.0)

---
updated-dependencies:
- dependency-name: nanoid
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-01-25 13:03:11 +00:00
Jffarge
4260b2dbcf
Merge pull request #1490 from dagger/dependabot/npm_and_yarn/website/amplitude-js-8.16.0
build(deps): bump amplitude-js from 8.15.1 to 8.16.0 in /website
2022-01-25 14:02:21 +01:00
jffarge
472a86d4ef Display caution message about docker requirement
Signed-off-by: jffarge <jeanfrancois.farge@gmail.com>
2022-01-25 13:41:48 +01:00
dependabot[bot]
2db670d5d6
build(deps): bump amplitude-js from 8.15.1 to 8.16.0 in /website
Bumps [amplitude-js](https://github.com/amplitude/amplitude-javascript) from 8.15.1 to 8.16.0.
- [Release notes](https://github.com/amplitude/amplitude-javascript/releases)
- [Changelog](https://github.com/amplitude/Amplitude-JavaScript/blob/main/CHANGELOG.md)
- [Commits](https://github.com/amplitude/amplitude-javascript/compare/v8.15.1...v8.16.0)

---
updated-dependencies:
- dependency-name: amplitude-js
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-01-25 12:39:15 +00:00
Gerhard Lazu
eebd91820b
Merge pull request #1476 from gerhard/finish-auto-release
Unblock auto-releases
2022-01-25 12:35:39 +00:00
Gerhard Lazu
8682f63aaa
Unblock auto-releases
Last time this ran, GoReleaser built an artefact with the wrong version
- it didn't bump it correctly. It was meant to build 0.1.0-alpha.33, but
it built 0.1.0-alpha.32 instead:
https://github.com/dagger/dagger/runs/4860126130?check_suite_focus=true#step:7:94

This new approach is a simpler and more explicit tag bump by leveraging
the semver-tool directly. A link to this utility is included in the
comments. We version it in this repository so that it is all
self-contained.

We also use the gh CLI tool directly, instead of a GitHub Action that
hides the implementation detail behind Typescript. We now have two very
simple gh CLI invocations that do all that. While we still use the
https://github.com/lewagon/wait-on-check-action GitHub Action to wait
on running checks, and abort if any check failed, I didn't want to
bundle that improvement into this PR - it's already big enough.

As a meaningful improvement, we should have a Dagger package that bumps
versions.  It would have been so much easier to use that Dagger package.
That implies us switching our GitHub Actions to Dagger, which we should
totally do. Small steps ftw!

Next step: run 0.1.0 release manually
Step 2: run 0.2.0-alpha.1 release manually
Step 3: wait for 0.2.0-alpha.2 to be produced automatically, tomorrow.

Pair: @aluzzardi

Signed-off-by: Gerhard Lazu <gerhard@lazu.co.uk>
2022-01-25 11:42:46 +00:00
Gerhard Lazu
2715b7b6d0
Merge pull request #1493 from aluzzardi/test-disable-ssh
test: disable tests relying on SSH
2022-01-25 11:15:51 +00:00
Jffarge
21f81bc8f6
Merge pull request #1491 from dagger/dependabot/npm_and_yarn/website/docusaurus-plugin-sass-0.2.2
build(deps): bump docusaurus-plugin-sass from 0.2.1 to 0.2.2 in /website
2022-01-25 10:56:38 +01:00
Andrea Luzzardi
3c45dd195b
Merge pull request #1475 from TomChv/test/docker
Add test on docker.#Run
2022-01-24 17:24:32 -08:00
Andrea Luzzardi
b242a2b9bc test: disable tests relying on SSH
Signed-off-by: Andrea Luzzardi <aluzzardi@gmail.com>
2022-01-24 17:21:05 -08:00
dependabot[bot]
0da34f00ef
build(deps): bump docusaurus-plugin-sass from 0.2.1 to 0.2.2 in /website
Bumps [docusaurus-plugin-sass](https://github.com/rlamana/docusaurus-plugin-sass) from 0.2.1 to 0.2.2.
- [Release notes](https://github.com/rlamana/docusaurus-plugin-sass/releases)
- [Commits](https://github.com/rlamana/docusaurus-plugin-sass/compare/v0.2.1...v0.2.2)

---
updated-dependencies:
- dependency-name: docusaurus-plugin-sass
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-01-24 19:25:16 +00:00
Vasek - Tom C
4ab852347b
Add test on docker.#Run
Signed-off-by: Vasek - Tom C <tom.chauveau@epitech.eu>
2022-01-22 13:33:23 +01:00
Andrea Luzzardi
a6330f8167
Merge pull request #1479 from aluzzardi/yarn-test-cleanup
test: clean up yarn test
2022-01-21 16:52:44 -08:00
Andrea Luzzardi
00e15676bc
Merge pull request #1474 from TomChv/fix/gitignore
Update and add missing gitignore
2022-01-21 16:14:24 -08:00
Solomon Hykes
ad07e9964f
Merge pull request #1477 from gerhard/how-to-run-europa-with-changelog-highlevel
Make changelog.com highlevel Europa have fewer failures
2022-01-21 13:33:13 -08:00
Andrea Luzzardi
8ff72a5fa3 test: clean up yarn test
Signed-off-by: Andrea Luzzardi <aluzzardi@gmail.com>
2022-01-21 12:45:59 -08:00
Vasek - Tom C
5cf25b457d
Update and add missing gitignore
Signed-off-by: Vasek - Tom C <tom.chauveau@epitech.eu>
2022-01-21 21:23:57 +01:00
Gerhard Lazu
d3f9fca4ef
Make changelog.com highlevel Europa run
We fixed a few issues with @shykes & @jlongtine, and @talentedmrjones
gave us this great command to run:

    cd pkg/universe.dagger.io/examples/changelog.com/highlevel
    dagger up --europa ./gerhard --log debug --log-format plain
    7:42PM DBG system | detected buildkit config    haveHostNetwork=true isActive=true version=v0.9.3
    7:42PM DBG system | loading plan    args=[
        "./gerhard/"
    ]
    7:42PM DBG system | vendoring packages    mod=/Users/gerhard/github.com/gerhard/dagger/pkg/universe.dagger.io
    7:42PM DBG system | spawning buildkit job    attrs=null localdirs={
        "/Users/gerhard/github.com/thechangelog/changelog.com/": "/Users/gerhard/github.com/thechangelog/changelog.com"
    }
    7:42PM INF actions.test.db.pull._op | computing
    7:42PM INF actions.test.run._exec | computing
    7:42PM INF inputs.directories.app | computing
    7:42PM INF actions.dev.build._dag."0"._op | computing
    7:42PM INF actions.test.build._dag."0"._op | computing
    7:42PM ERR actions.test.run._exec | failed: invalid FS at path "actions.test.run._exec.input": FS is not set    duration=0s
    7:42PM DBG inputs.directories.app | loading local directory    path=/Users/gerhard/github.com/thechangelog/changelog.com/
    7:42PM ERR actions.dev.build._dag."0"._op | canceled    duration=0s
    7:42PM ERR actions.test.db.pull._op | canceled    duration=0s
    7:42PM ERR actions.test.build._dag."0"._op | canceled    duration=0s
    7:42PM ERR inputs.directories.app | canceled    duration=0s
    7:42PM FTL system | failed to up environment: task failed: actions.test.run._exec: invalid FS at path "actions.test.run._exec.input": FS is not set

The next step is to figure out why this is failing @jlongtine.

Signed-off-by: Gerhard Lazu <gerhard@lazu.co.uk>
2022-01-21 19:49:28 +00:00
Andrea Luzzardi
0611eec75b
Merge pull request #1462 from aluzzardi/netlify-universe
netlify: Europa port
2022-01-20 19:06:28 -08:00
Joel Longtine
b73c572a17
Merge pull request #1470 from jlongtine/cue-flow-definitions-remove
Disallow Definitions as Tasks
2022-01-20 19:51:48 -07:00
Joel Longtine
b1f66b4a99 Disallow Definitions as Tasks
Signed-off-by: Joel Longtine <joel@dagger.io>
2022-01-20 19:38:24 -07:00
Andrea Luzzardi
5e950b6fe9 stdlib: expose dagger.#Source
Signed-off-by: Andrea Luzzardi <aluzzardi@gmail.com>
2022-01-20 16:50:53 -08:00
Andrea Luzzardi
5016cf5e30 netlify: Europa port
- Fix netlify.#Deploy (there's still FIXMEs)
- Externalize the `deploy.sh` script
- Add tests
- Misc engine fixes for more explicit error messages

Signed-off-by: Andrea Luzzardi <aluzzardi@gmail.com>
2022-01-20 16:10:14 -08:00
Andrea Luzzardi
7cd17c39bc
Merge pull request #1468 from aluzzardi/nested-docker-build
docker.#Build: support for nested builds
2022-01-20 16:09:30 -08:00
Andrea Luzzardi
2ce9934f7c docker.#Build: support for nested builds
Signed-off-by: Andrea Luzzardi <aluzzardi@gmail.com>
2022-01-20 15:45:41 -08:00
Gerhard Lazu
5d5ab86126
Merge pull request #1464 from gerhard/use-contributing-from-github
Use CONTRIBUTING from our org
2022-01-20 19:02:46 +00:00
Gerhard Lazu
88d78a963d
Use CONTRIBUTING from our org
Rather than having multiple CONTRIBUTING files, one for each repository,
which we will need to keep in sync, we could use GitHub's special .github
repository for community files.

This idea was first reported by @bpo in the context of the examples
repository: https://github.com/dagger/examples/pull/47#issuecomment-1012517202

I have added it as https://github.com/dagger/.github and explained how
the contributing flow now changed for first-time contributors to *any*
repository in our org: https://github.com/dagger/examples/pull/47#issuecomment-1013450052

There is more info on this feature here:
https://docs.github.com/en/communities/setting-up-your-project-for-healthy-contributions/creating-a-default-community-health-file

We could continue by adding CODE_OF_CONDUCT, SECURITY etc. files and all
our repositories will use them, without needing to add these files to
each repository.

Is this a GitHub feature something that fits us?

Signed-off-by: Gerhard Lazu <gerhard@lazu.co.uk>
2022-01-20 16:29:07 +00:00