Error while launching the application #4
Description
- % of customers impacted: [100]%
- Affected Users: [Engineers / Operators / Customers]
- Is revenue impacted: [Yes / No]
- Urgency: [High / Medium / Low]
- Deadline: [Date]
Description of Bug
Instance is not launching every single time we configure the application
What should the expected behavior be
Platform Affected
[ ] Dev
[ ] Preview
[ ] Production
Steps to Reproduce
Steps to reproduce the behavior
Additional context
From AWS account.
Relevant screenshots
Error logs from EBS events:
Create environment operation is complete, but with errors. For more information, see troubleshooting documentation.
[Instance: i-09b310f4235bfc2e9] Command failed on instance. Return code: 1 Output: Engine execution has encountered an error..
Instance deployment failed. For details, see 'eb-engine.log'.
Relevant eb-engine.log
/var/log/web.stdout.log
Sep 7 07:55:56 ip-172-31-44-139 web: /bin/sh: application: command not found
Sep 7 07:55:57 ip-172-31-44-139 web: /bin/sh: application: command not found
Sep 7 07:55:57 ip-172-31-44-139 web: /bin/sh: application: command not found
Sep 7 07:55:57 ip-172-31-44-139 web: /bin/sh: application: command not found
Sep 7 07:55:58 ip-172-31-44-139 web: /bin/sh: application: command not found
/var/log/eb-engine.log
2023/09/07 07:55:54.901081 [INFO] Executing instruction: configure healthd specific proxy conf
2023/09/07 07:55:54.902815 [INFO] Running command /bin/sh -c systemctl show -p PartOf healthd.service
2023/09/07 07:55:54.909056 [INFO] Running command /bin/sh -c systemctl daemon-reload
2023/09/07 07:55:54.974719 [INFO] Running command /bin/sh -c systemctl reset-failed
2023/09/07 07:55:54.979509 [INFO] Running command /bin/sh -c systemctl is-enabled aws-eb.target
2023/09/07 07:55:54.983062 [INFO] Running command /bin/sh -c systemctl enable aws-eb.target
2023/09/07 07:55:55.055425 [INFO] Running command /bin/sh -c systemctl start aws-eb.target
2023/09/07 07:55:55.060697 [INFO] Running command /bin/sh -c systemctl enable healthd.service
2023/09/07 07:55:55.136012 [INFO] Created symlink from /etc/systemd/system/multi-user.target.wants/healthd.service to /etc/systemd/system/healthd.service.
2023/09/07 07:55:55.136078 [INFO] Running command /bin/sh -c systemctl show -p PartOf healthd.service
2023/09/07 07:55:55.141505 [INFO] Running command /bin/sh -c systemctl is-active healthd.service
2023/09/07 07:55:55.144972 [INFO] Running command /bin/sh -c systemctl start healthd.service
2023/09/07 07:55:55.167960 [INFO] Copying file /opt/elasticbeanstalk/config/private/healthd/healthd_logformat.conf to /var/proxy/staging/nginx/conf.d/healthd_logformat.conf
2023/09/07 07:55:55.168945 [INFO] Copying file /opt/elasticbeanstalk/config/private/healthd/healthd_nginx.conf to /var/proxy/staging/nginx/conf.d/elasticbeanstalk/healthd.conf
2023/09/07 07:55:55.170041 [INFO] Executing instruction: configure log streaming
2023/09/07 07:55:55.170050 [INFO] log streaming is not enabled
2023/09/07 07:55:55.170054 [INFO] disable log stream
2023/09/07 07:55:55.170068 [INFO] Running command /bin/sh -c systemctl show -p PartOf amazon-cloudwatch-agent.service
2023/09/07 07:55:55.179984 [INFO] Running command /bin/sh -c systemctl stop amazon-cloudwatch-agent.service
2023/09/07 07:55:55.189588 [INFO] Executing instruction: GetToggleForceRotate
2023/09/07 07:55:55.189612 [INFO] Checking if logs need forced rotation
2023/09/07 07:55:55.189631 [INFO] Running command /bin/sh -c /opt/aws/bin/cfn-get-metadata -s arn:aws:cloudformation:us-west-2:147985732667:stack/awseb-e-wpy2emnhff-stack/d095b300-4d53-11ee-a7a3-0afc390dc713 -r AWSEBAutoScalingGroup --region us-west-2
2023/09/07 07:55:55.744439 [INFO] Running command /bin/sh -c /opt/aws/bin/cfn-get-metadata -s arn:aws:cloudformation:us-west-2:147985732667:stack/awseb-e-wpy2emnhff-stack/d095b300-4d53-11ee-a7a3-0afc390dc713 -r AWSEBBeanstalkMetadata --region us-west-2
2023/09/07 07:55:56.214490 [INFO] Generating rsyslog config from Procfile
2023/09/07 07:55:56.215976 [INFO] Running command /bin/sh -c systemctl restart rsyslog.service
2023/09/07 07:55:56.249176 [INFO] Executing instruction: PostBuildEbExtension
2023/09/07 07:55:56.249205 [INFO] Starting executing the config set Infra-EmbeddedPostBuild.
2023/09/07 07:55:56.249227 [INFO] Running command /bin/sh -c /opt/aws/bin/cfn-init -s arn:aws:cloudformation:us-west-2:147985732667:stack/awseb-e-wpy2emnhff-stack/d095b300-4d53-11ee-a7a3-0afc390dc713 -r AWSEBAutoScalingGroup --region us-west-2 --configsets Infra-EmbeddedPostBuild
2023/09/07 07:55:56.610416 [INFO] Finished executing the config set Infra-EmbeddedPostBuild.
2023/09/07 07:55:56.610497 [INFO] Executing instruction: CleanEbExtensions
2023/09/07 07:55:56.610713 [INFO] Cleaned ebextensions subdirectories from app staging directory.
2023/09/07 07:55:56.610720 [INFO] Executing instruction: RunAppDeployPreDeployHooks
2023/09/07 07:55:56.610735 [INFO] Executing platform hooks in .platform/hooks/predeploy/
2023/09/07 07:55:56.610751 [INFO] The dir .platform/hooks/predeploy/ does not exist
2023/09/07 07:55:56.610753 [INFO] Finished running scripts in /var/app/staging/.platform/hooks/predeploy
2023/09/07 07:55:56.610759 [INFO] Executing instruction: stop X-Ray
2023/09/07 07:55:56.610762 [INFO] stop X-Ray ...
2023/09/07 07:55:56.610771 [INFO] Running command /bin/sh -c systemctl show -p PartOf xray.service
2023/09/07 07:55:56.619817 [WARN] stopProcess Warning: process xray is not registered
2023/09/07 07:55:56.619841 [INFO] Running command /bin/sh -c systemctl stop xray.service
2023/09/07 07:55:56.626763 [INFO] Executing instruction: stop proxy
2023/09/07 07:55:56.626792 [INFO] Running command /bin/sh -c systemctl show -p PartOf httpd.service
2023/09/07 07:55:56.630915 [WARN] deregisterProcess Warning: process httpd is not registered, skipping...
2023/09/07 07:55:56.630956 [INFO] Running command /bin/sh -c systemctl show -p PartOf nginx.service
2023/09/07 07:55:56.636551 [WARN] deregisterProcess Warning: process nginx is not registered, skipping...
2023/09/07 07:55:56.636569 [INFO] Executing instruction: FlipApplication
2023/09/07 07:55:56.636573 [INFO] fetching environment variables...
2023/09/07 07:55:56.636595 [INFO] no go.mod file, setting GOPATH=/var/app/current
2023/09/07 07:55:56.636692 [INFO] Purge old process...
2023/09/07 07:55:56.636702 [INFO] Removing /var/app/current/ if it exists
2023/09/07 07:55:56.636711 [INFO] Renaming /var/app/staging/ to /var/app/current/
2023/09/07 07:55:56.636723 [INFO] Register application processes...
2023/09/07 07:55:56.636726 [INFO] Registering the proc: web
2023/09/07 07:55:56.636735 [INFO] Running command /bin/sh -c systemctl show -p PartOf web.service
2023/09/07 07:55:56.642189 [INFO] Running command /bin/sh -c systemctl daemon-reload
2023/09/07 07:55:56.755548 [INFO] Running command /bin/sh -c systemctl reset-failed
2023/09/07 07:55:56.759652 [INFO] Running command /bin/sh -c systemctl is-enabled eb-app.target
2023/09/07 07:55:56.763266 [INFO] Copying file /opt/elasticbeanstalk/config/private/aws-eb.target to /etc/systemd/system/eb-app.target
2023/09/07 07:55:56.766593 [INFO] Running command /bin/sh -c systemctl enable eb-app.target
2023/09/07 07:55:56.855143 [INFO] Created symlink from /etc/systemd/system/multi-user.target.wants/eb-app.target to /etc/systemd/system/eb-app.target.
2023/09/07 07:55:56.855191 [INFO] Running command /bin/sh -c systemctl start eb-app.target
2023/09/07 07:55:56.860136 [INFO] Running command /bin/sh -c systemctl enable web.service
2023/09/07 07:55:56.947217 [INFO] Created symlink from /etc/systemd/system/multi-user.target.wants/web.service to /etc/systemd/system/web.service.
2023/09/07 07:55:56.947245 [INFO] Running command /bin/sh -c systemctl show -p PartOf web.service
2023/09/07 07:55:56.952015 [INFO] Running command /bin/sh -c systemctl is-active web.service
2023/09/07 07:55:56.955391 [INFO] Running command /bin/sh -c systemctl start web.service
2023/09/07 07:55:56.975099 [INFO] Job for web.service failed because the control process exited with error code. See "systemctl status web.service" and "journalctl -xe" for details.
2023/09/07 07:55:56.975126 [ERROR] An error occurred during execution of command [app-deploy] - [FlipApplication]. Stop running the command. Error: Register application failed because the registration of proc web failed:
startProcess Failure: starting process "web" failed: Command /bin/sh -c systemctl start web.service failed with error exit status 1. Stderr:Job for web.service failed because the control process exited with error code. See "systemctl status web.service" and "journalctl -xe" for details.
2023/09/07 07:55:56.975130 [INFO] Executing cleanup logic
2023/09/07 07:55:56.975229 [INFO] CommandService Response: {"status":"FAILURE","api_version":"1.0","results":[{"status":"FAILURE","msg":"Engine execution has encountered an error.","returncode":1,"events":[{"msg":"Instance deployment successfully generated a 'Procfile'.","timestamp":1694073354893,"severity":"INFO"},{"msg":"Instance deployment: You didn't include a 'go.mod' file in your source bundle. Elastic Beanstalk set the 'GOPATH' environment property to the application path.","timestamp":1694073356636,"severity":"INFO"},{"msg":"Instance deployment failed. For details, see 'eb-engine.log'.","timestamp":1694073356975,"severity":"ERROR"}]}]}
2023/09/07 07:55:56.975380 [INFO] Platform Engine finished execution on command: app-deploy
2023/09/07 08:13:18.644755 [INFO] Starting...
2023/09/07 08:13:18.644792 [INFO] Starting EBPlatform-PlatformEngine
2023/09/07 08:13:18.644808 [INFO] reading event message file
2023/09/07 08:13:18.644983 [INFO] Engine received EB command cfn-hup-exec
2023/09/07 08:13:18.708319 [INFO] Running command /bin/sh -c /opt/aws/bin/cfn-get-metadata -s arn:aws:cloudformation:us-west-2:147985732667:stack/awseb-e-wpy2emnhff-stack/d095b300-4d53-11ee-a7a3-0afc390dc713 -r AWSEBAutoScalingGroup --region us-west-2
2023/09/07 08:13:19.051654 [INFO] Running command /bin/sh -c /opt/aws/bin/cfn-get-metadata -s arn:aws:cloudformation:us-west-2:147985732667:stack/awseb-e-wpy2emnhff-stack/d095b300-4d53-11ee-a7a3-0afc390dc713 -r AWSEBBeanstalkMetadata --region us-west-2
2023/09/07 08:13:19.377310 [INFO] checking whether command tail-log is applicable to this instance...
2023/09/07 08:13:19.377321 [INFO] this command is applicable to the instance, thus instance should execute command
2023/09/07 08:13:19.377324 [INFO] Engine command: (tail-log)
2023/09/07 08:13:19.377386 [INFO] Executing instruction: GetTailLogs
2023/09/07 08:13:19.377389 [INFO] Tail Logs...
2023/09/07 08:13:19.377668 [INFO] Running command /bin/sh -c tail -n 100 /var/log/web.stdout.log
2023/09/07 08:13:19.379391 [INFO] Running command /bin/sh -c tail -n 100 /var/log/eb-engine.log