Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question about timeouts #119

Open
joscul opened this issue Apr 21, 2021 · 4 comments
Open

Question about timeouts #119

joscul opened this issue Apr 21, 2021 · 4 comments

Comments

@joscul
Copy link

joscul commented Apr 21, 2021

Hello,

I have followed the examples here: https://aws.amazon.com/blogs/compute/introducing-the-c-lambda-runtime/

When I run my internal execution so that it takes 5 seconds everything works fine. But when I run it for 70 seconds I never get any response and the lambda function seems to be restarting several times. My guess is that is has to do with some timeouts. But how do I configure them? I cannot find any good developer reference.

static invocation_response my_handler(invocation_request const& req, Aws::S3::S3Client const& client) {
	using namespace Aws::Utils::Json;
	JsonValue json(req.payload);
	if (!json.WasParseSuccessful()) {
		return invocation_response::failure("Failed to parse input JSON", "InvalidJSON");
	}

	auto v = json.View();

	if (!v.ValueExists("s3bucket") || !v.ValueExists("s3key") || !v.GetObject("s3bucket").IsString() ||
		!v.GetObject("s3key").IsString()) {
		return invocation_response::failure("Missing input value s3bucket or s3key", "InvalidJSON");
	}

	auto bucket = v.GetString("s3bucket");
	auto key = v.GetString("s3key");

	AWS_LOGSTREAM_INFO(TAG, "Attempting to download file from s3://" << bucket << "/" << key);

	// Internal execution about 70 seconds...
       string response = "Success!";

	return invocation_response::success("We did it! Response: " + response, "application/json");
}

std::function<std::shared_ptr<Aws::Utils::Logging::LogSystemInterface>()> GetConsoleLoggerFactory() {
	return [] {
		return Aws::MakeShared<Aws::Utils::Logging::ConsoleLogSystem>(
			"console_logger", Aws::Utils::Logging::LogLevel::Info);
	};
}

Aws::Client::ClientConfiguration getS3Config() {

	Aws::Client::ClientConfiguration config;
	config.region = "us-east-1";
	config.scheme = Aws::Http::Scheme::HTTP;

	return config;
}

Aws::Client::ClientConfiguration getS3ConfigWithBundle() {

	cout << "USING S3 REGION: " << Aws::Environment::GetEnv("AWS_REGION") << endl;

	Aws::Client::ClientConfiguration config;
	config.region = Aws::Environment::GetEnv("AWS_REGION");
	config.scheme = Aws::Http::Scheme::HTTP;

	return config;
}

void run_lambda_handler() {

	Aws::S3::S3Client client(getS3ConfigWithBundle());
	auto handler_fn = [&client](aws::lambda_runtime::invocation_request const& req) {
		return my_handler(req, client);
	};
	run_handler(handler_fn);
}

int main(int argc, const char **argv) {
	Aws::SDKOptions options;
	options.loggingOptions.logLevel = Aws::Utils::Logging::LogLevel::Info;
	options.loggingOptions.logger_create_fn = GetConsoleLoggerFactory();
	Aws::InitAPI(options);

	run_lambda_handler();

	Aws::ShutdownAPI(options);

	return 0;
}
@marcomagdy
Copy link
Contributor

Can you paste the logs from cloud watch?

@joscul
Copy link
Author

joscul commented Apr 22, 2021

Hello,

Yes hera are the logs from one of those runs, nothing unusual it just restarts three times from one invokation:


No older events at this moment. Retry
--
  | 2021-04-21T12:31:29.862+02:00 | START RequestId: ebfa388c-7b20-4c1a-9ed8-33170026e4bf Version: $LATEST
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.855 Aws_Init_Cleanup [140060645824192] Initiate AWS SDK for C++ with Version:1.9.1
  | 2021-04-21T12:31:29.862+02:00 | [TRACE] 2021-04-21 10:31:29.859 FileSystemUtils [140060645824192] Checking HOME for the home directory.
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.859 FileSystemUtils [140060645824192] Environment value for variable HOME is
  | 2021-04-21T12:31:29.862+02:00 | [WARN] 2021-04-21 10:31:29.859 FileSystemUtils [140060645824192] Home dir not stored in environment, trying to fetch manually from the OS.
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Pulled /home/sbx_user1051 as home directory from the OS.
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Home directory is missing the final / appending one to normalize
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Final Home Directory is /home/sbx_user1051/
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 Aws::Config::AWSConfigFileProfileConfigLoader [140060645824192] Initializing config loader against fileName /home/sbx_user1051/.aws/credentials and using profilePrefix = 0
  | 2021-04-21T12:31:29.862+02:00 | [TRACE] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Checking HOME for the home directory.
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Environment value for variable HOME is
  | 2021-04-21T12:31:29.862+02:00 | [WARN] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Home dir not stored in environment, trying to fetch manually from the OS.
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Pulled /home/sbx_user1051 as home directory from the OS.
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Home directory is missing the final / appending one to normalize
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Final Home Directory is /home/sbx_user1051/
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 Aws::Config::AWSConfigFileProfileConfigLoader [140060645824192] Initializing config loader against fileName /home/sbx_user1051/.aws/config and using profilePrefix = 1
  | 2021-04-21T12:31:29.862+02:00 | [TRACE] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Checking HOME for the home directory.
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Environment value for variable HOME is
  | 2021-04-21T12:31:29.862+02:00 | [WARN] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Home dir not stored in environment, trying to fetch manually from the OS.
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Pulled /home/sbx_user1051 as home directory from the OS.
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Home directory is missing the final / appending one to normalize
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Final Home Directory is /home/sbx_user1051/
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 Aws::Config::AWSConfigFileProfileConfigLoader [140060645824192] Unable to open config file /home/sbx_user1051/.aws/credentials for reading.
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 Aws::Config::AWSProfileConfigLoader [140060645824192] Failed to reload configuration.
  | 2021-04-21T12:31:29.862+02:00 | [TRACE] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Checking HOME for the home directory.
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Environment value for variable HOME is
  | 2021-04-21T12:31:29.862+02:00 | [WARN] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Home dir not stored in environment, trying to fetch manually from the OS.
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Pulled /home/sbx_user1051 as home directory from the OS.
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Home directory is missing the final / appending one to normalize
  | 2021-04-21T12:31:29.862+02:00 | [DEBUG] 2021-04-21 10:31:29.862 FileSystemUtils [140060645824192] Final Home Directory is /home/sbx_user1051/
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 Aws::Config::AWSConfigFileProfileConfigLoader [140060645824192] Unable to open config file /home/sbx_user1051/.aws/config for reading.
  | 2021-04-21T12:31:29.862+02:00 | [INFO] 2021-04-21 10:31:29.862 Aws::Config::AWSProfileConfigLoader [140060645824192] Failed to reload configuration.
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.862 event-loop [140060645824192] id=0x555557144b00: Initializing edge-triggered epoll
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.862 event-loop [140060645824192] id=0x555557144b00: Using eventfd for cross-thread notifications.
  | 2021-04-21T12:31:29.874+02:00 | [TRACE] 2021-04-21 10:31:29.862 event-loop [140060645824192] id=0x555557144b00: eventfd descriptor 5.
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.862 event-loop [140060645824192] id=0x555557144b00: Starting event-loop thread.
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.862 dns [140060645824192] id=0x555557144e80: Initializing default host resolver with 8 max host entries.
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.862 channel-bootstrap [140060645824192] id=0x555557147360: Initializing client bootstrap with event-loop group 0x55555713c780
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.862 event-loop [140060645725952] id=0x555557144b00: main loop started
  | 2021-04-21T12:31:29.874+02:00 | [TRACE] 2021-04-21 10:31:29.862 event-loop [140060645725952] id=0x555557144b00: subscribing to events on fd 5
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.862 event-loop [140060645725952] id=0x555557144b00: default timeout 100000, and max events to process per tick 100
  | 2021-04-21T12:31:29.874+02:00 | [TRACE] 2021-04-21 10:31:29.862 event-loop [140060645725952] id=0x555557144b00: waiting for a maximum of 100000 ms
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.873 CurlHttpClient [140060645824192] Initializing Curl library with version: 7.68.0, ssl version: OpenSSL/1.1.1f
  | 2021-04-21T12:31:29.874+02:00 | [DEBUG] 2021-04-21 10:31:29.873 ClientConfiguration [140060645824192] ClientConfiguration will use SDK Auto Resolved profile: [default] if not specified by users.
  | 2021-04-21T12:31:29.874+02:00 | [WARN] 2021-04-21 10:31:29.873 ClientConfiguration [140060645824192] Retry Strategy will use the default max attempts.
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.873 EC2MetadataClient [140060645824192] Creating AWSHttpResourceClient with max connections 2 and scheme http
  | 2021-04-21T12:31:29.874+02:00 | [INFO] 2021-04-21 10:31:29.873 CurlHandleContainer [140060645824192] Initializing CurlHandleContainer with size 2
  | 2021-04-21T12:31:29.876+02:00 | USING S3 REGION: us-east-1
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.873 ClientConfiguration [140060645824192] ClientConfiguration will use SDK Auto Resolved profile: [default] if not specified by users.
  | 2021-04-21T12:31:29.876+02:00 | [WARN] 2021-04-21 10:31:29.873 ClientConfiguration [140060645824192] Retry Strategy will use the default max attempts.
  | 2021-04-21T12:31:29.876+02:00 | [TRACE] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Checking HOME for the home directory.
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Environment value for variable HOME is
  | 2021-04-21T12:31:29.876+02:00 | [WARN] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Home dir not stored in environment, trying to fetch manually from the OS.
  | 2021-04-21T12:31:29.876+02:00 | [INFO] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Pulled /home/sbx_user1051 as home directory from the OS.
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Home directory is missing the final / appending one to normalize
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Final Home Directory is /home/sbx_user1051/
  | 2021-04-21T12:31:29.876+02:00 | [INFO] 2021-04-21 10:31:29.876 Aws::Config::AWSConfigFileProfileConfigLoader [140060645824192] Initializing config loader against fileName /home/sbx_user1051/.aws/credentials and using profilePrefix = 0
  | 2021-04-21T12:31:29.876+02:00 | [TRACE] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Checking HOME for the home directory.
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Environment value for variable HOME is
  | 2021-04-21T12:31:29.876+02:00 | [WARN] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Home dir not stored in environment, trying to fetch manually from the OS.
  | 2021-04-21T12:31:29.876+02:00 | [INFO] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Pulled /home/sbx_user1051 as home directory from the OS.
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Home directory is missing the final / appending one to normalize
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Final Home Directory is /home/sbx_user1051/
  | 2021-04-21T12:31:29.876+02:00 | [TRACE] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Checking HOME for the home directory.
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Environment value for variable HOME is
  | 2021-04-21T12:31:29.876+02:00 | [WARN] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Home dir not stored in environment, trying to fetch manually from the OS.
  | 2021-04-21T12:31:29.876+02:00 | [INFO] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Pulled /home/sbx_user1051 as home directory from the OS.
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Home directory is missing the final / appending one to normalize
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 FileSystemUtils [140060645824192] Final Home Directory is /home/sbx_user1051/
  | 2021-04-21T12:31:29.876+02:00 | [INFO] 2021-04-21 10:31:29.876 ProfileConfigFileAWSCredentialsProvider [140060645824192] Setting provider to read credentials from /home/sbx_user1051/.aws/credentials for credentials file and /home/sbx_user1051/.aws/config for the config file , for use with profile default
  | 2021-04-21T12:31:29.876+02:00 | [INFO] 2021-04-21 10:31:29.876 ProcessCredentialsProvider [140060645824192] Setting process credentials provider to read config from default
  | 2021-04-21T12:31:29.876+02:00 | [WARN] 2021-04-21 10:31:29.876 STSAssumeRoleWithWebIdentityCredentialsProvider [140060645824192] Token file must be specified to use STS AssumeRole web identity creds provider.
  | 2021-04-21T12:31:29.876+02:00 | [INFO] 2021-04-21 10:31:29.876 SSOCredentialsProvider [140060645824192] Setting sso credentials provider to read config from default
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 DefaultAWSCredentialsProviderChain [140060645824192] The environment variable value AWS_CONTAINER_CREDENTIALS_RELATIVE_URI is
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 DefaultAWSCredentialsProviderChain [140060645824192] The environment variable value AWS_CONTAINER_CREDENTIALS_FULL_URI is
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 DefaultAWSCredentialsProviderChain [140060645824192] The environment variable value AWS_EC2_METADATA_DISABLED is
  | 2021-04-21T12:31:29.876+02:00 | [DEBUG] 2021-04-21 10:31:29.876 ClientConfiguration [140060645824192] ClientConfiguration will use SDK Auto Resolved profile: [default] if not specified by users.
  | 2021-04-21T12:31:29.876+02:00 | [WARN] 2021-04-21 10:31:29.876 ClientConfiguration [140060645824192] Retry Strategy will use the default max attempts.
  | 2021-04-21T12:31:29.881+02:00 | [INFO] 2021-04-21 10:31:29.876 EC2MetadataClient [140060645824192] Creating AWSHttpResourceClient with max connections 2 and scheme http
  | 2021-04-21T12:31:29.881+02:00 | [INFO] 2021-04-21 10:31:29.876 CurlHandleContainer [140060645824192] Initializing CurlHandleContainer with size 2
  | 2021-04-21T12:31:29.881+02:00 | [INFO] 2021-04-21 10:31:29.876 InstanceProfileCredentialsProvider [140060645824192] Creating Instance with default EC2MetadataClient and refresh rate 300000
  | 2021-04-21T12:31:29.881+02:00 | [INFO] 2021-04-21 10:31:29.876 DefaultAWSCredentialsProviderChain [140060645824192] Added EC2 metadata service credentials provider to the provider chain.
  | 2021-04-21T12:31:29.881+02:00 | [DEBUG] 2021-04-21 10:31:29.876 EnvironmentAWSCredentialsProvider [140060645824192] Found credential in environment with access key id ASIAQFQTS34JUTVPY4Z4
  | 2021-04-21T12:31:29.881+02:00 | [INFO] 2021-04-21 10:31:29.876 EnvironmentAWSCredentialsProvider [140060645824192] Found secret key
  | 2021-04-21T12:31:29.881+02:00 | [INFO] 2021-04-21 10:31:29.876 EnvironmentAWSCredentialsProvider [140060645824192] Found sessionToken
  | 2021-04-21T12:31:29.881+02:00 | [INFO] 2021-04-21 10:31:29.876 CurlHandleContainer [140060645824192] Initializing CurlHandleContainer with size 25
  | 2021-04-21T12:31:29.881+02:00 | [TRACE] 2021-04-21 10:31:29.880 event-loop [140060645725952] id=0x555557144b00: wake up with -1 events to process.
  | 2021-04-21T12:31:29.881+02:00 | [TRACE] 2021-04-21 10:31:29.880 event-loop [140060645725952] id=0x555557144b00: running scheduled tasks.
  | 2021-04-21T12:31:29.881+02:00 | [TRACE] 2021-04-21 10:31:29.880 event-loop [140060645725952] id=0x555557144b00: no more scheduled tasks using default timeout.
  | 2021-04-21T12:31:29.881+02:00 | [TRACE] 2021-04-21 10:31:29.880 event-loop [140060645725952] id=0x555557144b00: waiting for a maximum of 100000 ms
  | 2021-04-21T12:31:29.881+02:00 | [INFO] 2021-04-21 10:31:29.881 LAMBDA_ALLOC [140060645824192] Attempting to download file from s3://commoncrawl/crawl-data/CC-MAIN-2021-10/segments/1614178389798.91/warc/CC-MAIN-20210309092230-20210309122230-00583.warc.gz
  | 2021-04-21T12:31:29.881+02:00 | Sleeping for 70 seconds
  | 2021-04-21T12:32:39.883+02:00 | END RequestId: ebfa388c-7b20-4c1a-9ed8-33170026e4bf
  | 2021-04-21T12:32:39.883+02:00 | REPORT RequestId: ebfa388c-7b20-4c1a-9ed8-33170026e4bf Duration: 70001.72 ms Billed Duration: 70254 ms Memory Size: 512 MB Max Memory Used: 57 MB Init Duration: 252.16 ms
  | 2021-04-21T12:33:31.711+02:00 | START RequestId: f8b96316-214c-468e-ba1e-9d0d3a2a6a25 Version: $LATEST
  | 2021-04-21T12:33:31.714+02:00 | [TRACE] 2021-04-21 10:33:31.711 event-loop [140060645725952] id=0x555557144b00: wake up with -1 events to process.
  | 2021-04-21T12:33:31.714+02:00 | [TRACE] 2021-04-21 10:33:31.711 event-loop [140060645725952] id=0x555557144b00: running scheduled tasks.
  | 2021-04-21T12:33:31.714+02:00 | [TRACE] 2021-04-21 10:33:31.711 event-loop [140060645725952] id=0x555557144b00: no more scheduled tasks using default timeout.
  | 2021-04-21T12:33:31.714+02:00 | [TRACE] 2021-04-21 10:33:31.711 event-loop [140060645725952] id=0x555557144b00: waiting for a maximum of 100000 ms
  | 2021-04-21T12:33:31.714+02:00 | [INFO] 2021-04-21 10:33:31.714 LAMBDA_ALLOC [140060645824192] Attempting to download file from s3://commoncrawl/crawl-data/CC-MAIN-2021-10/segments/1614178389798.91/warc/CC-MAIN-20210309092230-20210309122230-00583.warc.gz
  | 2021-04-21T12:33:31.714+02:00 | Sleeping for 70 seconds
  | 2021-04-21T12:34:41.715+02:00 | END RequestId: f8b96316-214c-468e-ba1e-9d0d3a2a6a25
  | 2021-04-21T12:34:41.715+02:00 | REPORT RequestId: f8b96316-214c-468e-ba1e-9d0d3a2a6a25 Duration: 70001.13 ms Billed Duration: 70002 ms Memory Size: 512 MB Max Memory Used: 57 MB
  | 2021-04-21T12:35:37.884+02:00 | START RequestId: d55b2cee-d203-4dd6-b148-1edb2b8e6412 Version: $LATEST
  | 2021-04-21T12:35:37.887+02:00 | [TRACE] 2021-04-21 10:35:37.884 event-loop [140060645725952] id=0x555557144b00: wake up with -1 events to process.
  | 2021-04-21T12:35:37.887+02:00 | [TRACE] 2021-04-21 10:35:37.884 event-loop [140060645725952] id=0x555557144b00: running scheduled tasks.
  | 2021-04-21T12:35:37.887+02:00 | [TRACE] 2021-04-21 10:35:37.884 event-loop [140060645725952] id=0x555557144b00: no more scheduled tasks using default timeout.
  | 2021-04-21T12:35:37.887+02:00 | [TRACE] 2021-04-21 10:35:37.884 event-loop [140060645725952] id=0x555557144b00: waiting for a maximum of 100000 ms
  | 2021-04-21T12:35:37.887+02:00 | [INFO] 2021-04-21 10:35:37.887 LAMBDA_ALLOC [140060645824192] Attempting to download file from s3://commoncrawl/crawl-data/CC-MAIN-2021-10/segments/1614178389798.91/warc/CC-MAIN-20210309092230-20210309122230-00583.warc.gz
  | 2021-04-21T12:35:37.887+02:00 | Sleeping for 70 seconds
  | 2021-04-21T12:36:47.890+02:00 | END RequestId: d55b2cee-d203-4dd6-b148-1edb2b8e6412
  | 2021-04-21T12:36:47.890+02:00 | REPORT RequestId: d55b2cee-d203-4dd6-b148-1edb2b8e6412 Duration: 70001.07 ms Billed Duration: 70002 ms Memory Size: 512 MB Max Memory Used: 57 MB

@marcomagdy
Copy link
Contributor

The logs show the AWS SDK attempting to read configuration from the local filesystem.

[INFO] 2021-04-21 10:31:29.876 ProfileConfigFileAWSCredentialsProvider [140060645824192] Setting provider to read credentials from /home/sbx_user1051/.aws/credentials for credentials file and /home/sbx_user1051/.aws/config for the config file , for use with profile default

I suggest you use the environment credential provider as in https://github.com/awslabs/aws-lambda-cpp/blob/master/examples/s3/main.cpp#L76. And make sure you set up the environment variables in Lambda.

@specious
Copy link
Contributor

The logs look like three successful invocations (the first one being a cold start) that each complete in about 70 seconds and return.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@marcomagdy @specious @joscul