Commit Graph

333 Commits

Author SHA1 Message Date
Antoine Cotten
f93dfe007e feat: Log setup error in case of failed curl command 2022-06-21 15:57:56 +02:00
Antoine Cotten
f7204daaee feat: Set explicit setup dependency on Elasticsearch 2022-06-21 14:05:55 +02:00
docker-elk-updater[bot]
384e3320e2 Update to v8.2.3 2022-06-19 11:37:38 +00:00
Antoine Cotten
e980a542e7 ci: Clean up orphan containers in each extension test 2022-06-08 10:05:07 +02:00
Antoine Cotten
29df29f808 feat(ext): Add Heartbeat extension
Closes #672
2022-06-03 17:33:15 +02:00
Antoine Cotten
003b94d565 doc: Mention known incompatibilities with Compose < 1.26
Closes #698
8.2206.1
2022-06-03 11:18:14 +02:00
Antoine Cotten
f808ff31cf ci: Auto-update Elastic version on tls branch 2022-05-29 11:24:38 +02:00
dependabot[bot]
94d6273524 chore(deps): Bump actions/checkout from 2 to 3 (#721) 2022-05-29 08:22:02 +00:00
dependabot[bot]
84e37a221f chore(deps): Bump peter-evans/create-pull-request from 3 to 4 (#718) 2022-05-29 08:17:12 +00:00
dependabot[bot]
de90bd06b4 chore(deps): Bump actions/setup-node from 2 to 3 (#719) 2022-05-29 08:17:09 +00:00
dependabot[bot]
0319b7e128 chore(deps): Bump actions/github-script from 5 to 6 (#720) 2022-05-29 08:17:07 +00:00
Antoine Cotten
66ff963e0a ci: Let Dependabot update GitHub actions 2022-05-29 10:08:19 +02:00
docker-elk-updater[bot]
3e2230e09a Update to v8.2.2 2022-05-29 00:24:41 +00:00
Antoine Cotten
9fd8a09f0d ci: Use GitHub runner based on Ubuntu 22.04
Includes Compose v2. See the full list of included software at
https://github.com/actions/virtual-environments/blob/ubuntu22/20220522.1/images/linux/Ubuntu2204-Readme.md
2022-05-25 22:35:55 +02:00
Antoine Cotten
1557e27bff doc: Render notes and warnings using GitHub admonitions
https://github.com/github/feedback/discussions/16925
2022-05-21 12:14:56 +02:00
Antoine Cotten
4319be7cd0 fix: Revert removal of -Xms JVM option
Logstash has '-Xms1g' set inside 'config/jvm.options', so either -Xms
must be set, or -Xmx must be greater than 1g (which is too high of a
default for docker-elk).

Elastic explicitly recommends setting -Xms and -Xmx to the same value
for Elasticsearch:
  https://www.elastic.co/guide/en/elasticsearch/reference/8.2/advanced-configuration.html#set-jvm-heap-size
2022-05-16 21:29:08 +02:00
Antoine Cotten
239099874a chore: Raise max heap size of Elasticsearch to 512 MB
This value should be a sane default. Modern versions require more
resources, and nowadays any consumer hardware should be able to have
access to this amount of memory.

Additionally, do not set a lower bound on the heap size, so that unused
space isn't unnecessarily committed to the JVM.
2022-05-16 20:53:17 +02:00
docker-elk-updater[bot]
164588d301 Update to v8.2.0 2022-05-08 00:25:12 +00:00
docker-elk-updater[bot]
5d844f3c91 Update to v8.1.3 2022-04-24 00:23:56 +00:00
docker-elk-updater[bot]
d9d43c2a40 Update to v8.1.2 2022-04-03 00:21:55 +00:00
docker-elk-updater[bot]
2ec05d65b2 Update to v8.1.1 2022-03-27 00:22:47 +00:00
docker-elk-updater[bot]
0f5dcf1d70 Update to v8.1.0 2022-03-13 08:10:50 +00:00
Antoine Cotten
1f26484b61 doc: Mention support for Compose V2
Closes #684
2022-03-12 17:25:20 +01:00
Antoine Cotten
12dc0a4b74 Revert "ci: Pin Compose version to v2.2.3"
This reverts commit 897720fa91.

A new version of Compose was released, with a fix for the issue we were
encountering.
2022-03-09 01:57:19 +01:00
Antoine Cotten
4fe6f68339 ci: Update list of auto-mergeable branch names 2022-03-06 11:07:29 +01:00
Antoine Cotten
488a88b4ca doc: Revert in-paragraph string replacement by update bot 2022-03-06 11:02:29 +01:00
docker-elk-updater[bot]
21aa0ce9af Update to v8.0.1 2022-03-06 10:00:13 +00:00
Antoine Cotten
897720fa91 ci: Pin Compose version to v2.2.3
v2.3.0 introduced a regression which causes the test CI workflow to
fail: https://github.com/docker/compose/issues/9234
2022-03-06 10:28:48 +01:00
Antoine Cotten
82b1e653b0 fix(logstash): Adjust role for ECS compatibility
'ecs_compatibility' is now on by default, therefore Logstash indices are
created with the naming pattern "ecs-logstash-*" when data streams are
disabled ('data_stream => false').
8.2203.1
2022-03-02 17:13:24 +01:00
Antoine Cotten
02dabf6fb1 fix(logstash): Allow managing "logstash" index
When data streams are disabled in Logstash's "elasticsearch" output
('data_stream => false'), Logstash falls back to managing "logstash-*"
indices and creates an index template with ILM enabled.
In this process, a write index for the alias "logstash" is created. This
step requires the "manage" privilege on the "logstash" alias.

Fixes #679
2022-03-02 17:13:16 +01:00
Antoine Cotten
159c934ad2 doc: Bump minimum Compose version requirement to 1.26.0
Prior to this version, surrounding quotes (single and double) were
preserved in values coming from the '.env' file, which is counter
intuitive and goes against the recommended practice of quoting values
containing special characters, such as passwords.

Closes #677
2022-02-28 15:33:50 +01:00
Antoine Cotten
9a52c6cf5f chore: Update animated demo for v8.0.0 2022-02-28 12:03:18 +01:00
Antoine Cotten
924a1e5987 chore: Update Compose file version to 3.7
Allows enabling the 'init' option in the 'setup' service.

Requires Docker 18.06.0 and Compose 1.22.0.
2022-02-28 09:50:52 +01:00
Antoine Cotten
a204596be7 fix: Explicitly make entrypoint of 'setup' service executable
The existing executable permission might not be preserved when users
download docker-elk as a Zip file.

Fixes #676
2022-02-28 09:46:27 +01:00
Antoine Cotten
eb1c6fa27e chore: Rename ELK_VERSION to ELASTIC_VERSION
More appropriate name considering that extensions, which aren't part of
the "ELK" stack, also rely on this variable.
2022-02-28 09:10:30 +01:00
Antoine Cotten
0a9c3ebd2c doc: Update "Philosophy" section to reflect latest changes
We do use a small amount of custom setup automation now.
2022-02-28 09:02:44 +01:00
Antoine Cotten
9877b39900 Automate management of required roles and user passwords (#671) 2022-02-21 11:19:43 +01:00
Antoine Cotten
641290c20a Apply SELinux options to bind mounts
https://docs.docker.com/storage/bind-mounts/

Related to #639
Closes #661
2022-02-11 20:11:22 +01:00
Antoine Cotten
a82e95d94e doc: Provide examples of config overrides via env vars 2022-02-11 19:51:43 +01:00
Antoine Cotten
ca98168da1 Quote passwords to prevent interpreting leading special chars
Closes #667
2022-02-11 19:10:58 +01:00
Antoine Cotten
b77b7fb66a fix: Swap flag with service name in Compose command
Related to #667
2022-02-11 19:10:58 +01:00
Antoine Cotten
370ebbfaf4 doc: Update "Initial Setup" section for v8.0.0
Starting with Elastic v8.0.0, it is no longer possible to run Kibana
using the bootstraped privileged `elastic` user.

Closes #666
2022-02-11 14:48:00 +01:00
Antoine Cotten
33a96e571a es: Remove deprecated monitoring setting 2022-02-10 19:56:19 +01:00
Antoine Cotten
6704d9f1d7 Update to v8.0.0 (#544)
List of changes impacting docker-elk:

- [logstash]: The output to Elasticsearch is handled as a data stream.

  Starting with v8.0.0, the `elasticsearch` output for Logstash sends
  log data to a data stream instead of `logstash-*` indices by default.
  The name of the default data stream is `logs-generic-default`.
  docker-elk remains unopinionated and simply uses Elastic's defaults
  like it always has, so users who prefer to retain the old behaviour
  need to explicitly opt-out of data streams in their Logstash
  pipelines.

  Refs:
  - https://www.elastic.co/guide/en/elasticsearch/reference/current/data-streams.html
  - https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#plugins-outputs-elasticsearch-data-streams

- [logstash]: The (legacy) monitoring data collection is now disabled.

  This feature was deprecated since v7.9.0, and removed in v8.0.0.

  Ref: https://www.elastic.co/guide/en/logstash/current/monitoring-internal-collection-legacy.html

- [kibana]: An index pattern for `logs-*` indices is automatically
  created.

  It used to be required to manually create an index pattern for indices
  managed by Logstash, even when using the default Logstash indices.
  This is no longer the case since the output data is now being handled
  as a data stream, and Kibana automatically creates index patterns for
  these.

- [elasticsearch]: The command line tool `elasticsearch-setup-passwords`
  was deprecated in favour of a new `elasticsearch-reset-password` tool.

  Passwords for built-in users must now be generated one by one.

  Ref: https://www.elastic.co/guide/en/elasticsearch/reference/current/setup-passwords.html

- [enterprise-search]: Kibana is now the new management interface, and
  the only one available moving forward.

  The old standalone Enterprise Search interface was removed in v8.0.0.

  Ref: https://www.elastic.co/guide/en/enterprise-search/current/user-interfaces.html
8.2202.1
2022-02-10 17:19:04 +01:00
Antoine Cotten
3882ce97e1 doc: Update links to Legacy APM Server Reference 2022-02-04 15:44:55 +01:00
docker-elk-updater[bot]
1a30af6e11 Update to v7.17.0 2022-02-04 14:37:42 +00:00
docker-elk-updater[bot]
ff35064836 Update to v7.16.3 2022-01-16 00:20:34 +00:00
Antoine Cotten
3ce7fc0ae3 ci: Fix race condition while checking container IP
Be resilient and recheck the container's status if its IP address
couldn't be determined on the first attempt.
2021-12-28 20:16:54 +01:00
docker-elk-updater[bot]
691ffd8764 Update to v7.16.2 2021-12-20 16:01:32 +00:00
docker-elk-updater[bot]
c7f4a8eac0 Update to v7.16.1 2021-12-13 16:18:54 +00:00