Denise

Branch: refs/heads/main Home: https://github.com/dreamwidth/dreamwidth Commit: 00b8f85a98e039eaaf2046ccb2bbc7e1ff07d60e https://github.com/dreamwidth/dreamwidth/commit/00b8f85a98e039eaaf2046ccb2bbc7e1ff07d60e Author: Mark Smith mark@dreamwidth.org Date: 2026-04-19 (Sun, 19 Apr 2026)

Changed paths: M app.psgi M bin/starman A cgi-bin/Plack/Middleware/DW/AccessLog.pm

Log Message:

Add JSON access log middleware for Grafana Loki

Replace Starman's default Apache Combined access log with a DW::AccessLog middleware that emits one JSON object per line to psgi.errors. Fields include method, path, status, bytes, duration_ms, host, remote_ip, and user_agent — all natively parseable by Loki's | json pipeline for dashboards.

Use --no-default-middleware to suppress Plack's built-in AccessLog, and enable ContentLength explicitly in app.psgi to preserve that behavior.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

To unsubscribe from these emails, change your notification settings at https://github.com/dreamwidth/dreamwidth/settings/notifications

Branch: refs/heads/main Home: https://github.com/dreamwidth/dreamwidth Commit: 439d836de1e77290f029a08afebd37d4b177f74f https://github.com/dreamwidth/dreamwidth/commit/439d836de1e77290f029a08afebd37d4b177f74f Author: Mark Smith mark@dreamwidth.org Date: 2026-04-12 (Sun, 12 Apr 2026)

Changed paths: A src/dwtool/internal/config/loki.go A src/dwtool/internal/loki/client.go M src/dwtool/main.go

Log Message:

Switch dwtool log-scan and esn-trace from CloudWatch to Loki

Logs now go directly to Grafana Cloud Loki via Fluent Bit, so dwtool needs to query Loki instead of CloudWatch. Adds a Loki HTTP client that queries /loki/api/v1/query_range with LogQL, and rewrites both log-scan and esn-trace to use it.

Credentials are loaded from ~/.config/dwtool/config.json (with DWTOOL_LOKI_HOST/USER/PASSWORD env var overrides). The Loki client strips Fluent Bit key_value wrapper and log4perl timestamp/level prefix from messages so output is clean.

Other fixes: - Renamed logscan → log-scan for consistency with esn-trace - Fixed flag parsing in esn-trace: Go's flag package stops at the first positional arg, so esn-trace URL -since 24h silently ignored -since. Args are now reordered so flags come first. - log-scan uses -service instead of -groups for filtering by Loki service label instead of CloudWatch log group glob - Service column is hidden when -service is specified (redundant)

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Commit: eae7aaa21ba6b5d07a1ed3378505a9a0b156b995 https://github.com/dreamwidth/dreamwidth/commit/eae7aaa21ba6b5d07a1ed3378505a9a0b156b995 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-12 (Sun, 12 Apr 2026)

Changed paths: M .github/workflows/tasks/web-canary-service.json M .github/workflows/tasks/web-shop-service.json M .github/workflows/tasks/web-stable-service.json M .github/workflows/tasks/web-unauthenticated-service.json

Log Message:

remove cloudwatch agent sidecar from web task definitions

The CW agent was configured to collect Apache access logs but was pointing at a -DISABLED log path, so it was burning resources for nothing. Removes the sidecar container, log-share volume, and associated mount from all four web service task definitions.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Compare: https://github.com/dreamwidth/dreamwidth/compare/b046642d6f54...eae7aaa21ba6

To unsubscribe from these emails, change your notification settings at https://github.com/dreamwidth/dreamwidth/settings/notifications

Branch: refs/heads/main Home: https://github.com/dreamwidth/dreamwidth Commit: ece0b7970913514a534e88d20b8383a4555ebe5a https://github.com/dreamwidth/dreamwidth/commit/ece0b7970913514a534e88d20b8383a4555ebe5a Author: Mark Smith mark@dreamwidth.org Date: 2026-04-12 (Sun, 12 Apr 2026)

Changed paths: M .github/workflows/tasks/worker-birthday-notify-service.json M .github/workflows/tasks/worker-change-poster-id-service.json M .github/workflows/tasks/worker-codebuild-notifier-service.json M .github/workflows/tasks/worker-content-importer-lite-service.json M .github/workflows/tasks/worker-content-importer-service.json M .github/workflows/tasks/worker-content-importer-verify-service.json M .github/workflows/tasks/worker-directory-meta-service.json M .github/workflows/tasks/worker-distribute-invites-service.json M .github/workflows/tasks/worker-dw-change-poster-id-service.json M .github/workflows/tasks/worker-dw-distribute-invites-service.json M .github/workflows/tasks/worker-dw-embeds-service.json M .github/workflows/tasks/worker-dw-esn-cluster-subs-service.json M .github/workflows/tasks/worker-dw-esn-filter-subs-service.json M .github/workflows/tasks/worker-dw-esn-fired-event-service.json M .github/workflows/tasks/worker-dw-esn-process-sub-service.json M .github/workflows/tasks/worker-dw-import-eraser-service.json M .github/workflows/tasks/worker-dw-incoming-email-service.json M .github/workflows/tasks/worker-dw-latest-feed-service.json M .github/workflows/tasks/worker-dw-lazy-cleanup-service.json M .github/workflows/tasks/worker-dw-mass-privacy-service.json M .github/workflows/tasks/worker-dw-send-email-service.json M .github/workflows/tasks/worker-dw-sphinx-copier-service.json M .github/workflows/tasks/worker-dw-support-notify-service.json M .github/workflows/tasks/worker-dw-synsuck-service.json M .github/workflows/tasks/worker-dw-xpost-service.json M .github/workflows/tasks/worker-embeds-service.json M .github/workflows/tasks/worker-expunge-users-service.json M .github/workflows/tasks/worker-import-eraser-service.json M .github/workflows/tasks/worker-import-scheduler-service.json M .github/workflows/tasks/worker-incoming-email-service.json M .github/workflows/tasks/worker-latest-feed-service.json M .github/workflows/tasks/worker-lazy-cleanup-service.json M .github/workflows/tasks/worker-paidstatus-service.json M .github/workflows/tasks/worker-process-privacy-service.json M .github/workflows/tasks/worker-resolve-extacct-service.json M .github/workflows/tasks/worker-schedule-synsuck-service.json M .github/workflows/tasks/worker-ses-incoming-email-service.json M .github/workflows/tasks/worker-shop-creditcard-charge-service.json M .github/workflows/tasks/worker-spellcheck-gm-service.json M .github/workflows/tasks/worker-sphinx-copier-service.json M .github/workflows/tasks/worker-sphinx-search-gm-service.json M .github/workflows/tasks/worker-support-notify-service.json M config/update-workflows.py

Log Message:

Ship worker logs directly to Grafana Cloud Loki via Fluent Bit

Regenerated all 42 worker task definitions to use awsfirelens with a Fluent Bit log_router sidecar instead of the awslogs driver. Worker logs now go directly to Grafana Cloud Loki over HTTPS, bypassing CloudWatch Logs entirely.

Each task definition gains a log_router container (~15MB RSS) running the AWS-maintained Fluent Bit image from private ECR. Loki credentials are injected via SSM secrets at task startup. The worker container's logDriver changes from awslogs to awsfirelens with the grafana-loki output plugin.

Fluent Bit's own logs still go to CloudWatch (/dreamwidth/fluent-bit) so the log router itself can be debugged if needed.

Generated by config/update-workflows.py from config/workers.json.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Commit: 0d49a7588ae0544ef51801c977e8df41c651e3b5 https://github.com/dreamwidth/dreamwidth/commit/0d49a7588ae0544ef51801c977e8df41c651e3b5 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-12 (Sun, 12 Apr 2026)

Changed paths: M cgi-bin/DW/Worker/ContentImporter.pm M cgi-bin/DW/Worker/ContentImporter/LiveJournal.pm

Log Message:

tidy

Compare: https://github.com/dreamwidth/dreamwidth/compare/d7d5b8fbd0bb...0d49a7588ae0

To unsubscribe from these emails, change your notification settings at https://github.com/dreamwidth/dreamwidth/settings/notifications

Branch: refs/heads/main Home: https://github.com/dreamwidth/dreamwidth Commit: 51d098321baa231958385df0c938af13be280ccb https://github.com/dreamwidth/dreamwidth/commit/51d098321baa231958385df0c938af13be280ccb Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M .devcontainer/devcontainer.json M .devcontainer/setup.sh M CLAUDE.md

Log Message:

Support parallel worktree devcontainers for multi-Claude workflows

Three fixes that allow multiple devcontainers to run simultaneously from git worktrees without conflicts:

• Add workspaceMount to always bind-mount at /workspaces/dreamwidth regardless of host folder name (worktrees have different names)
• Use dynamic host ports (-p 0:8080) instead of hardcoded 8080:8080 so multiple containers don't fight over the same port
• Give each workspace its own MySQL volume to prevent DB corruption
• Symlink extlib from the image when it doesn't exist on disk (worktrees don't have extlib/ since it's gitignored)

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Commit: 3fcdc3a52918fb76bc84761b4428b66cce064066 https://github.com/dreamwidth/dreamwidth/commit/3fcdc3a52918fb76bc84761b4428b66cce064066 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M cgi-bin/LJ/Comment.pm

Log Message:

Add per-check diagnostic logging to Comment::visible_to

When called during ESN processing (CURRENT_TRACE is set), visible_to now logs which specific check caused the rejection: entry_not_loaded, entry_not_visible (with security level), screened, or poster_suspended. Previously all four cases produced a generic not_visible_to_watcher in the matches_filter trace with no way to distinguish them after the fact.

Triggered by a real case (trace 3:2296509:6184:0) where all 40 subscribers were rejected with not_visible_to_watcher on a public unscreened comment in a personal journal — couldn't determine root cause without per-check visibility.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Compare: https://github.com/dreamwidth/dreamwidth/compare/1c54be1b97b9...3fcdc3a52918

To unsubscribe from these emails, change your notification settings at https://github.com/dreamwidth/dreamwidth/settings/notifications

Branch: refs/heads/main Home: https://github.com/dreamwidth/dreamwidth Commit: c3394d8c9d9ca1cbd8e169d3a1e85849e9affbaa https://github.com/dreamwidth/dreamwidth/commit/c3394d8c9d9ca1cbd8e169d3a1e85849e9affbaa Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M cgi-bin/DW/Worker/ContentImporter.pm

Log Message:

Add DW::Stats metrics to content importer job outcomes

Instrument all four outcome methods (ok, fail, temp_fail, decline) in DW::Worker::ContentImporter with a single metric dw.worker.importer.job_completed, using labels for result, item, and hostname to support Prometheus-style querying.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

To unsubscribe from these emails, change your notification settings at https://github.com/dreamwidth/dreamwidth/settings/notifications

Branch: refs/heads/main Home: https://github.com/dreamwidth/dreamwidth Commit: 62c0b8e4ee1d12728c8f737eac0061161522fdaa https://github.com/dreamwidth/dreamwidth/commit/62c0b8e4ee1d12728c8f737eac0061161522fdaa Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M src/dwtool/internal/aws/ecs.go

Log Message:

Remove legacy web image from web-canary and web-unauthenticated deploy targets

Both services are now fully on web22. This removes the old "web" option from the deploy flow so only web22 is offered, matching web-shop.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Commit: 58ffd06e3da3ae4ea7b3122dac7a46685a4c35e4 https://github.com/dreamwidth/dreamwidth/commit/58ffd06e3da3ae4ea7b3122dac7a46685a4c35e4 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M .gitignore

Log Message:

.gitignore updates

Commit: 7cbc4931b3974ac99de9e3657f389ed8125a5566 https://github.com/dreamwidth/dreamwidth/commit/7cbc4931b3974ac99de9e3657f389ed8125a5566 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M cgi-bin/DW/Worker/ContentImporter/LiveJournal.pm M doc/dependencies-cpanm

Log Message:

Fix content-importer-verify TLS connection failures

The importer's XMLRPC calls to remote LJ-based sites were failing with "SSL wants a read first" due to a TLS 1.3 handshake issue with IO::Socket::SSL 2.098 and OpenSSL 3.0 (see openssl/openssl#7967). Force TLS 1.2 in call_xmlrpc as a workaround.

Also add missing Regexp::IPv6 dependency, which IO::Socket::IP needs for address parsing — its absence caused a secondary "Can't locate Regexp/IPv6.pm" failure.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Commit: 9eff707e837547024e178f5b0b8cbc30c6653350 https://github.com/dreamwidth/dreamwidth/commit/9eff707e837547024e178f5b0b8cbc30c6653350 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: A bin/dev/importer-debug M bin/ecs-shell

Log Message:

Add importer-debug diagnostic script and fix ecs-shell on macOS

Add bin/dev/importer-debug for diagnosing content-importer connectivity issues on ECS containers. Tests DNS, TCP, TLS, HTTP, and XMLRPC layers independently with timing and detailed error output.

Fix ecs-shell exec command failing on macOS due to base64 -w0 flag not being supported (macOS uses base64 -i instead).

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Compare: https://github.com/dreamwidth/dreamwidth/compare/388d47d72bfa...9eff707e8375

To unsubscribe from these emails, change your notification settings at https://github.com/dreamwidth/dreamwidth/settings/notifications

Branch: refs/heads/main Home: https://github.com/dreamwidth/dreamwidth Commit: 388d47d72bfa348ef6378e9f5e638e9fa85da491 https://github.com/dreamwidth/dreamwidth/commit/388d47d72bfa348ef6378e9f5e638e9fa85da491 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M cgi-bin/DW/Task.pm M cgi-bin/DW/TaskQueue/LocalDisk.pm M cgi-bin/DW/TaskQueue/SQS.pm M etc/config-local.pl.example A t/taskqueue-serialize.t A t/taskqueue.t

Log Message:

Add JSON wire format for task queue with gradual rollout support

Adds serialize/deserialize methods to DW::Task that support a new v2 JSON wire format alongside the legacy Storable format. This enables non-Perl consumers (e.g. Go workers) to read task queue messages.

$LJ::TASK_QUEUE_JSON controls the rollout as a float 0-1 (e.g. 0.01 = 1% of messages serialized as JSON). Default is 0 (all Storable). All consumers can read both formats regardless of this setting. If JSON encoding fails for a task (e.g. blessed objects in args), it falls back to Storable with a warning and stat tag identifying the task class.

Also adds task queue config documentation to config-local.pl.example and comprehensive test coverage for LocalDisk lifecycle, serialization round-trips, and queue_attributes.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

To unsubscribe from these emails, change your notification settings at https://github.com/dreamwidth/dreamwidth/settings/notifications

Branch: refs/heads/main Home: https://github.com/dreamwidth/dreamwidth Commit: 727c496a47ff8257b62e438d302f0ca999c54d36 https://github.com/dreamwidth/dreamwidth/commit/727c496a47ff8257b62e438d302f0ca999c54d36 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M src/dwtool/internal/aws/cloudwatch.go M src/dwtool/main.go A src/dwtool/run.sh

Log Message:

Add logscan CLI subcommand and build helper script to dwtool

Adds dwtool logscan for searching CloudWatch logs across all Dreamwidth services by keyword, with time range and log group glob filtering. Searches in 1-hour chunks (newest first) so results stream incrementally. Also adds run.sh to check dependencies, build, and run dwtool in one step.

Co-Authored-By: Claude Opus 4.6 (1M context) noreply@anthropic.com

Commit: d81f640239516e9c21e95a6afdc73f4fc4d63156 https://github.com/dreamwidth/dreamwidth/commit/d81f640239516e9c21e95a6afdc73f4fc4d63156 Author: Mark Smith mark@dreamwidth.org Date: 2026-04-11 (Sat, 11 Apr 2026)

Changed paths: M cgi-bin/Plack/Middleware/DW/WriteTimeout.pm M t/plack-write-timeout.t

Log Message:

Tidy fixes

Compare: https://github.com/dreamwidth/dreamwidth/compare/fe8199f3512e...d81f64023951

To unsubscribe from these emails, change your notification settings at https://github.com/dreamwidth/dreamwidth/settings/notifications

Branch: refs/heads/dependabot/go_modules/src/dwtool/github.com/aws/aws-sdk-go-v2/service/cloudwatchlogs-1.65.0 Home: https://github.com/dreamwidth/dreamwidth Commit: 0d0dde31d0f1e40afdb75a34408cfff9e453fd6c https://github.com/dreamwidth/dreamwidth/commit/0d0dde31d0f1e40afdb75a34408cfff9e453fd6c Author: dependabot[bot] <49699333+dependabot[bot]users> Date: 2026-04-08 (Wed, 08 Apr 2026)

Changed paths: M src/dwtool/go.mod M src/dwtool/go.sum

Log Message:

Bump github.com/aws/aws-sdk-go-v2/service/cloudwatchlogs in /src/dwtool

Bumps github.com/aws/aws-sdk-go-v2/service/cloudwatchlogs from 1.63.1 to 1.65.0. - Release notes - Commits