how to use s3 endpoint in node js

[vamseekrishna25]

after installing noobaa in openshift we get an s3 endpoint and credentials how can i connect to it through code any libraries to be used what functions can i use after connecting like to create a bucket etc

[romayalon]

Hey @vamseekrishna25
I'll recommend you to use the aws-sdk library for node js. you can find the relevant docs in here https://docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/S3.html
when creating a new AWS.S3 object you can specify noobaa s3 endpoint and credentials.

[vamseekrishna25]

const axios = require("axios");
const express = require('express');
const app = express();
const AWS = require('aws-sdk');
const https = require('https')
const ACCESS_KEY_ID = "xxxx"
const SECRET_ACCESS_KEY = "xxxx"
AWS.config.update({
httpOptions: {
agent: new https.Agent({
rejectUnauthorized: false
})
}
});
const s3 = new AWS.S3({
accessKeyId: ACCESS_KEY_ID,
secretAccessKey: SECRET_ACCESS_KEY,
endpoint: new AWS.Endpoint("https://s3-noobaa.apps.cnss-deeghuge7.os.fyre.ibm.com"),
region:''
})
s3.listBuckets(function(err, data) {
if (err) console.log(err, err.stack); // an error occurred
else console.log(data); // successful response
});
var params = {
Bucket: "example1"
};
s3.createBucket(params, function(err, data) {
if (err) console.log(err, err.stack); // an error occurred
else console.log(data); // successful response
});

s3.listBuckets(function(err, data) {
if (err) console.log(err, err.stack); // an error occurred
else console.log(data); // successful response
});
app.listen(80);

output:
{
Buckets: [
{ Name: 'garry', CreationDate: 2021-04-12T13:58:46.000Z },
{ Name: 'vamsee', CreationDate: 2021-04-12T13:58:46.000Z },
{ Name: 'xyz', CreationDate: 2021-04-12T13:58:46.000Z },
{ Name: 'test123', CreationDate: 2021-04-12T13:58:46.000Z },
{ Name: 'zebra', CreationDate: 2021-04-12T13:58:46.000Z }
],
Owner: { DisplayName: 'xxxx', ID: 'xxxx' }
}
{
Buckets: [
{ Name: 'garry', CreationDate: 2021-04-12T13:58:46.000Z },
{ Name: 'vamsee', CreationDate: 2021-04-12T13:58:46.000Z },
{ Name: 'xyz', CreationDate: 2021-04-12T13:58:46.000Z },
{ Name: 'test123', CreationDate: 2021-04-12T13:58:46.000Z },
{ Name: 'zebra', CreationDate: 2021-04-12T13:58:46.000Z }
],
Owner: { DisplayName: 'xxxxx', ID: 'xxx' }
}
Error [XMLParserError]: Unexpected close tag
Line: 106
Column: 9
Char: >
at error (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\sax\lib\sax.js:667:10)
at strictFail (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\sax\lib\sax.js:693:7)
at closeTag (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\sax\lib\sax.js:887:9)
at SAXParser.write (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\sax\lib\sax.js:1449:13)
at Parser.exports.Parser.Parser.parseString (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\xml2js\lib\parser.js:322:31)
at Parser.parseString (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\xml2js\lib\parser.js:5:59)
at NodeXmlParser.parse (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\aws-sdk\lib\xml\node_parser.js:31:10)
at Request.extractError (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\aws-sdk\lib\services\s3.js:704:39)
at Request.callListeners (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\aws-sdk\lib\sequential_executor.js:106:20)
at Request.emit (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\aws-sdk\lib\sequential_executor.js:78:10) {
code: 'XMLParserError',
retryable: true,
time: 2021-04-12T13:58:50.472Z,
statusCode: 503
} XMLParserError: Unexpected close tag
Line: 106
Column: 9
Char: >
at error (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\sax\lib\sax.js:667:10)
at strictFail (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\sax\lib\sax.js:693:7)
at closeTag (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\sax\lib\sax.js:887:9)
at SAXParser.write (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\sax\lib\sax.js:1449:13)
at Parser.exports.Parser.Parser.parseString (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\xml2js\lib\parser.js:322:31)
at Parser.parseString (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\xml2js\lib\parser.js:5:59)
at NodeXmlParser.parse (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\aws-sdk\lib\xml\node_parser.js:31:10)
at Request.extractError (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\aws-sdk\lib\services\s3.js:704:39)
at Request.callListeners (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\aws-sdk\lib\sequential_executor.js:106:20)
at Request.emit (C:\Users\LANKISETTISAIVAMSEEK\Documents\minio-nodejs\node_modules\aws-sdk\lib\sequential_executor.js:78:10)

i am able list the buckets but not able create bucket or put object in bucket using javascript aws-sdk i am getting above error

[romayalon]

please add s3ForcePathStyle: true to your AWS.S3 configuration.

[vamseekrishna25]

Thank you it got created but it was in the internal storage can i know if we can provide options like attaching our created bucket to our resource, setting policies like bucket quota ,tier,polices from aws-sdk like we do in rpc api calls

[romayalon]

these are noobaa internal settings, but you can send rpc calls from your code too.
and regarding your resource, have you created it on noobaa?

[vamseekrishna25]

yes
i have created it in noobaa in ocp cluster