elastic.io iPaaS component that connects to Salesforce API
Salesforse-component Completeness Matrix
The component uses Salesforce - API Version 46.0 by defaults but can be overwritten by the environment variable SALESFORCE_API_VERSION
Name | Mandatory | Description | Values |
---|---|---|---|
SALESFORCE_API_VERSION | false | Determines API version of Salesforce to use | Default: 46.0 |
REFRESH_TOKEN_RETRIES | false | Determines how many retries to refresh token should be done before throwing an error | Default: 10 |
HASH_LIMIT_TIME | false | Hash expiration time in ms | Default: 600000 |
HASH_LIMIT_ELEMENTS | false | Hash size number limit | Default: 10 |
UPSERT_TIME_OUT | false | Time out for Upsert Object action in ms |
Default: 120000 (2min) |
Authentication occurs via OAuth 2.0.
In order to make OAuth work, you need a new App in your Salesforce. During app creation process you will be asked to specify
the callback URL, to process OAuth authentication via elastic.io platform your callback URL should be https://your-tenant.elastic.io/callback/oauth2
.
More information you can find here.
During credentials creation you would need to:
- select existing Auth Client from drop-down list
Choose Auth Client
or create the new one. For creating Auth Client you should specify following fields:
Field name | Mandatory | Description |
---|---|---|
Name | true | your Auth Client's name |
Client ID | true | your OAuth client key |
Client Secret | true | your OAuth client secret |
Authorization Endpoint | true | your OAuth authorization endpoint. For production use https://login.salesforce.com/services/oauth2/authorize , for sandbox - https://test.salesforce.com/services/oauth2/authorize |
Token Endpoint | true | your OAuth Token endpoint for refreshing access token. For production use https://login.salesforce.com/services/oauth2/token , for sandbox - https://test.salesforce.com/services/oauth2/token |
- fill field
Name Your Credential
- click on
Authenticate
button - if you have not logged in Salesforce before then log in by entering data in the login window that appears - click on
Verify
button for verifying your credentials - click on
Save
button for saving your credentials
Please note: Salesforce migration or any changes that affect endpoints, single sign-on (SSO), OAuth and JSON web tokens (JWT), and other connections can lead to unpredictable behavior that can cause authentication issues. To avoid this after making changes you need to create new credentials and authenticate again, once this is done the old ones can be safely removed from the platform.
- Object Type Dropdown: Indicates Object Type to be fetched
- Selected Fields Multiselect dropdown: list with all Object Fields. Select fields, which will be returned in response. That can prevent 431 and 414 Errors.
- Include linked objects Multiselect dropdown: list with all the related child and parent objects of the selected object type. List entries are given as
Object Name/Reference To (Relationship Name)
. Select one or more related objects, which will be join queried and included in the response from your Salesforce Organization. Please see the Limitations section below for use case advisories. - Emit behavior Dropdown: Indicates emit objects individually or emit by page
- Start Time - TextField (string, optional): Indicates the beginning time to start retrieving events from in ISO 8601 Date time utc format - YYYY-MM-DDThh:mm:ssZ
- End Time - TextField (string, optional, defaults to never): If provided, don’t fetch records modified after this time in ISO 8601 Date time utc format - YYYY-MM-DDThh:mm:ssZ
- Size of Polling Page - TextField (optional, positive integer, max 10000, defaults to 10000): Indicates the size of pages to be fetched
- Process Single Page Per Execution - Checkbox: Indicates that if the number of changed records exceeds the maximum number of results in a page, instead of fetching the next page immediately, wait until the next flow start to fetch the next page
- For
Fetch page
: An object with key results that has an array as its value - For
Emit Individually
: Each object fill the entire message
- If records reach
Size of Polling Page
flow will find largest update date and use it asStart Time
for next iterations, results with this date will be excluded from that iteration and include in the next one. - If all records from one iteration will have same 'LastModifiedDate' they will be proceed, but all objects in the next iteration will start from date strictly greater than this, to avoid this use bigger
Size of Polling Page
- Highly not recommended use very small (less than 5)
Size of Polling Page
(look at previous point) - When a binary field (primitive type
base64
, e.g. Documents, Attachments, etc) is selected on Include linked objects, an error will be thrown:MALFORMED_QUERY: Binary fields cannot be selected in join queries. Instead of querying objects with binary fields as linked objects (such as children Attachments), try querying them directly.
There is also a limit to the number of linked objects that you can query at once - beyond two or three, depending on the number of fields in the linked objects, Salesforce could potentially return a Status Code 431 or 414 error, meaning the query is too long. Finally, due to a bug with multiselect dropdowns, it is recommended to deselect all of the elements in this field before you change your selection in the Object dropdown list.
Continuously runs the same SOQL Query and emits results according to Output method
configuration field.
Use the Salesforce Object Query Language (SOQL) to search your organization’s Salesforce data for specific information.
SOQL is similar to the SELECT statement in the widely used Structured Query Language (SQL) but is designed specifically for Salesforce data.
This trigger allows you to interact with your data using SOQL.
- SOQL Query - Input field for your SOQL Query
- Output method - dropdown list with options:
Emit all
- all found records will be emitted in one arrayrecords
, andEmit individually
- each found object will be emitted individual. Optional field, defaults to:Emit individually
. - Don't emit on empty results - checkbox, optional. If selected, component will not produce empty messages when result is empty.
This trigger will subscribe for any platform Event using Salesforce streaming API.
- Event object name - Input field where you should select the type of platform event which you want to subscribe E.g.
My platform event
Setup --> Integrations --> Platform Events --> New Platform Event
You can find more detail information in the Platform Events Intro Documentation.
At the moment this trigger can be used only for "Realtime" flows.
This trigger will subscribe for any platform Event using Pub/Sub API.
- Event object name - (dropdown, required): Input field where you should select the type of platform event to which you want to subscribe E.g.
My platform event
- Pub/Sub API Endpoint - (string, optional): You can set Pub/Sub API Endpoint manually or leave it blank for default:
api.pubsub.salesforce.com:7443
. Details about Pub/Sub API Endpoints can be found here - Number of events per request - (positive integer, optional, defaults to 10, max 100): Salesforce uses batches of events to deliver to the component, the bigger number may increase processing speed, but if the batch size is too big, you can get out of memory error. If there are fewer events ready than the batch size, they will be delivered anyway.
- Start from Replay Id - (positive integer, optional): In the Salesforce platform events and change data capture events are retained in the event bus for 3 days and you can subscribe at any position in the stream by providing here Replay Id from the last event. This field is used only for the first execution, following executions will use the Replay Id from the latest event to get a new one.
None.
- event - (object, required): Store
replayId
of this message which can be used to retrieve records that were created after (using it asStart from Replay Id
in configuration) - payload - (object, required): Dynamically generated content of the event
- The component starts tracking changes after the first execution (it means you have to "run-now" flow with this trigger or wait for the first execution by the scheduler to establish a connection and only after this new event will be listened)
- If you use "Ordinary" flow:
- Make sure that you execute it at least once per 3 days - according to the documentation Salesforce stores events for up to 3 days.
- To
Retrieve new sample from Salesforce v2
you need to trigger an event on Salesforce side or provide a sample manually
Get New and Updated Objects Polling
Polls existing and updated objects. You can select any custom or built-in object for your Salesforce instance.
- Object - Input field where you should select the type of object which updates you want to get. E.g.
Account
; - Start Time - Indicates the beginning time to start polling from. Defaults to
1970-01-01T00:00:00.000Z
; - End Time - If provided, don’t fetch records modified after this time;
- Size of Polling Page - Indicates the size of pages to be fetched. You can set positive integer, max
10 000
, defaults to1000
; - Process single page per execution - You can select on of options (defaults to
yes
):yes
- if the number of changed records exceeds the maximum number of results in a page, wait until the next flow start to fetch the next page;no
- if the number of changed records exceeds the maximum number of results in a page, the next pages will fetching in the same execution.
- Include linked objects - Multiselect dropdown list with all the related child and parent objects of the selected object type. List entries are given as
Object Name/Reference To (Relationship Name)
. Select one or more related objects, which will be join queried and included in the response from your Salesforce Organization. Please see the Limitations section below for use case advisories. - Output method - dropdown list with options:
Emit all
- all found records will be emitted in one arrayrecords
, andEmit individually
- each found object will be emitted individual. Optional field, defaults to:Emit individually
. - Max Fetch Count - limit for a number of messages that can be fetched. 1,000 is the default value when the variable is not set.
For example, you have 234 “Contact” objects, 213 of them were changed from 2019-01-01. You want to select all “Contacts” that were changed from 2019-01-01, set the page size to 100 and process single page per execution. For you purpose you need to specify following fields:
- Object:
Contact
- Start Time:
2019-01-01T00:00:00.000Z
- Size of Polling Page:
100
- Process single page per execution:
yes
(or leave this empty)
As a result, all contacts will be fetched in three calls of the trigger: two of them by 100 items, and the last one by 13.
If you select no
in Process single page per execution, all 213 contacts will be fetched in one call of the trigger.
When a binary field (primitive type base64
, e.g. Documents, Attachments, etc) is selected on Include linked objects, an error will be thrown: 'MALFORMED_QUERY: Binary fields cannot be selected in join queries. Instead of querying objects with binary fields as linked objects (such as children Attachments), try querying them directly.' There is also a limit to the number of linked objects that you can query at once - beyond two or three, depending on the number of fields in the linked objects, Salesforce could potentially return a Status Code 431 or 414 error, meaning the query is too long. Finally, due to a bug with multiselect dropdowns, it is recommended to deselect all of the elements in this field before you change your selection in the Object dropdown list.
Bulk API provides a simple interface for quickly loading large amounts of data from CSV file into Salesforce (up to 10'000 records). Action takes a CSV file from the attachment as an input. CSV file format is described in the Salesforce documentatio
- Operation - dropdown list with 4 supported operations:
Create
,Update
,Upsert
andDelete
. - Object - dropdown list where you should choose the object type to perform bulk operation. E.g.
Case
. - Timeout - maximum time to wait until the server completes a bulk operation (default:
600
sec).
- External ID Field - a name of the External ID field for
Upsert
operation. E.g.my_external_id__c
Result is an object with a property result: array
. It contains objects with 3 fields.
- id -
string
, salesforce object id - success -
boolean
, if operation was successfultrue
- errors -
array
, if operation failed contains description of errors
- No errors thrown in case of failed Object Create/Update/Delete/Upsert (
"success": "false"
). - Object ID is needed for Update and Delete.
- External ID is needed for Upsert.
- Salesforce processes up to 10'000 records from the input CSV file.
Fetches records to a CSV file.
- SOQL Query - Input field where you should type the SOQL query. E.g.
"SELECT ID, Name from Contact where Name like 'John Smi%'"
Result is a CSV file in the attachment.
Creates a new Selected Object. Action creates a single object.
Note:
In case of an Attachment object type you should specify Body
in base64 encoding.
ParentId
is a Salesforce ID of an object (Account, Lead, Contact) which an attachment is going to be attached to.
- Object - Input field where you should choose the object type, which you want to find. E.g.
Account
- Utilize data attachment from previous step (for objects with a binary field) - a checkbox, if it is checked and an input message contains an attachment and specified object has a binary field (type of base64) then the input data is put into object's binary field. In this case any data specified for the binary field in the data mapper is discarded.
This action will automatically retrieve all existing fields of chosen object type that available on your Salesforce organization
Input metadata is fetched dynamically from your Salesforce account.
Output metadata is the same as input metadata, so you may expect all fields that you mapped as input to be returned as output.
When Utilize data attachment from previous step (for objects with a binary field) is checked and this action is used with Local Agent error would be thrown: 'getaddrinfo ENOTFOUND steward-service.platform.svc.cluster.local steward-service.platform.svc.cluster.local:8200'
Deletes an object by a selected field. One can filter by either unique fields or all fields of that sobject.
- Object - dropdown list where you should choose the object type, which you want to find. E.g.
Account
. - Type Of Search - dropdown list with two values:
Unique Fields
andAll Fields
. - Lookup by field - dropdown list with all fields on the selected object, if on Type Of Search is chosen
All Fields
, or with all fields on the selected object wheretype
isid
orunique
istrue
, if on Type Of Search is chosenUnique Fields
then all searchable fields both custom and standard will be available for selection.
Input metadata is fetched dynamically from your Salesforce account and depends on field Lookup by field
.
Result is an object with 3 fields.
- id -
string
, salesforce object id - success -
boolean
, if operation was successfultrue
- errors -
array
, if operation fails, it will contain description of errors
Lookup an object by a selected field. Action creates a single object.
- Object - Dropdown list displaying all searchable object types. Select one type to query, e.g.
Account
. - Type Of Search - Dropdown list with two values:
Unique Fields
andAll Fields
. - Lookup by field - Dropdown list with all fields on the selected object if the Type Of Search is
All Fields
. If the Type Of Search isUnique Fields
, the dropdown lists instead all fields on the selected object wheretype
isid
orunique
istrue
. - Include referenced objects - Multiselect dropdown list with all the related child and parent objects of the selected object type. List entries are given as
Object Name/Reference To (Relationship Name)
. Select one or more related objects, which will be join queried and included in the response from your Salesforce Organization. Please see the Limitations section below for use case advisories. - Allow criteria to be omitted - Checkbox. If checked and nothing is specified in criteria, an empty object will be returned. If not checked and nothing is found, the action will throw an error.
- Allow zero results - Checkbox. If checked and nothing is found in your Salesforce Organization, an empty object will be returned. If not checked and nothing is found, the action will throw an error.
- Pass binary data to the next component (if found object has it) - Checkbox. If it is checked and the found object record has a binary field (primitive type
base64
), then its data will be passed to the next component as a binary attachment and link to it will be replaced to link on the platform - Enable Cache Usage - Flag to enable cache usage.
Input metadata is fetched dynamically from your Salesforce account. Metadata contains one field whose name, type and mandatoriness are generated according to the value of the configuration fields Lookup by field and Allow criteria to be omitted.
Output metadata is the same as input metadata, so you may expect all fields that you mapped as input to be returned as output.
-
When a binary field (primitive type
base64
, e.g. Documents, Attachments, etc) is selected on Include linked objects, an error will be thrown:MALFORMED_QUERY: Binary fields cannot be selected in join queries. Instead of querying objects with binary fields as linked objects (such as children Attachments), try querying them directly.
There is also a limit to the number of linked objects that you can query at once - beyond two or three, depending on the number of fields in the linked objects, Salesforce could potentially return a Status Code 431 or 414 error, meaning the query is too long. Finally, due to a bug with multiselect dropdowns, it is recommended to deselect all of the elements in this field before you change your selection in the Object dropdown list. -
Not supported object lookup when selected field value is
null
-
When Pass binary data to the next component (if found object has it) is checked and this action is used with Local Agent, an error will be thrown: 'getaddrinfo ENOTFOUND steward-service.platform.svc.cluster.local steward-service.platform.svc.cluster.local:8200'
Action has caching mechanism. By default action stores last 10 request-response pairs for 10 min duration. This parameters can be changed by setting environment variables:
- HASH_LIMIT_TIME - Hash expiration time in milis
- HASH_LIMIT_ELEMENTS - Hash size number limit
Lookup a list of objects satisfying specified criteria.
- Object - dropdown list where you should choose the object type, which you want to find. E.g.
Account
. - Include deleted - checkbox, if checked - deleted records will be included into the result list.
- Output method - dropdown list with following values: "Emit all", "Emit page", "Emit individually".
- Number of search terms - text field to specify a number of search terms (positive integer number [1-99] or 0).
- Enable Cache Usage - Flag to enable cache usage.
- Max Fetch Count - limit for a number of messages that can be fetched. 1,000 is the default value when the variable is not set.
Depending on the the configuration field Output method the input metadata can contain different fields: Output method - "Emit page": Field "Page size" - optional positive integer that defaults to 1000; Field "Page number" - required non-negative integer (starts with 0, default value 0);
Output method - "Emit all": Field "Maximum number of records" - optional positive integer (default value 1000);
Output method - "Emit individually": Field "Maximum number of records" - optional positive integer (default value 10000);
Note that the number of records the component emits may affect the performance of the platform/component.
Groups of fields for each search term go next:
Field "Field name" - string represents object's field (a list of allowed values is available); Field "Field value" - string represents value for selected field; Field "Condition" - one of the following: "=", "!=", "<", "<=", ">", ">=", "LIKE", "IN", "NOT IN";
Between each two term's group of fields:
Field "Logical operator" - one of the following: "AND", "OR";
Output data is an object, with a field "results" that is an array of objects.
Action has caching mechanism. By default action stores last 10 request-response pairs for 10 min duration. This parameters can be changed by setting environment variables:
- HASH_LIMIT_TIME - Hash expiration time in milis
- HASH_LIMIT_ELEMENTS - Hash size number limit
If Output method
set to Emit page
maximum "Page number" must be less or equal to "Page size"/2000
Executing a SOQL Query that may return many objects. Use the Salesforce Object Query Language (SOQL) to search your organization’s Salesforce data for specific information. SOQL is similar to the SELECT statement in the widely used Structured Query Language (SQL) but is designed specifically for Salesforce data. This action allows you to interact with your data using SOQL. Empty object will be returned, if query doesn't find any data.
- Optional batch size - A positive integer specifying batch size. If no batch size is specified then results of the query will be emitted one-by-one, otherwise, query results will be emitted in an array of maximum batch size.
- Allow all results to be returned in a set - checkbox which allows emitting query results in a single array.
Optional batch size
andMax Fetch Count
options are ignored in this case. - Include deleted - checkbox, if checked - deleted records will be included into the result list.
- Max Fetch Count - limit for a number of messages that can be fetched. 1,000 is the default value when the variable is not set.
- SOQL Query - Input field where you should type the SOQL query. E.g.
"SELECT ID, Name from Contact where Name like 'John Smi%'"
This function executes a custom REST API call request. By default, the service called is /services/data
, which encompasses most of the services provided by Salesforce.
Alternatively, you can call any other services, such as /services/apexrest
, by specifying the full URL instead of a relative one.
- HTTP Verb - Allowed values GET, POST, PUT, PATCH, DELETE, HEAD, Required. HTTP verb to use in the request.
- To call services based on the
/services/data
endpoint, you can utilize a relative path, for instance,query/?q=SELECT+Id,Name+FROM+Account
. This automatically constructs the URL as follows:https://{your_instance}.salesforce.com/services/data/{SALESFORCE_API_VERSION}/query/?q=SELECT+Id,Name+FROM+Account
- For calling other services like
/services/apexrest
, provide the full URL, such ashttps://{your_instance}.salesforce.com/services/apexrest/myApexClass
- To call services based on the
- Path - String, Required. Use a relative path to make a request (for a list of all types of objects -
sobjects
, e.g., to list the type of objects Account -sobjects/account
). Since Salesforce sends the endpoint that must be called dynamically, there is no need to enter the base URL like this -https://{INSTANCE_NAME}.salesforce.com/services/data/v{SALESFORCE_API_VERSION}/sobjects/{SALESFORCE_OBJECT}
. Instead, you should use a relative path -sobjects/{SALESFORCE_OBJECT}
. - Request Body - Object, Optional. Body to attach to the HTTP Request
- Response Object (Object, optional): HTTP response body
- More information about available resources you can find here
- Examples of using REST API resources can be found here
For the methods PUT and HEAD you need to specify the whole path (e.g. services/OpportunityLineItem/00kR0000001WJJAIA4/OpportunityLineItemSchedules
) which have conflicts with /services/data/v{SALESFORCE_API_VERSION}/{RESOURCE}
path, so Raw Request does not work for these two methods (PUT and HEAD) just for now.
Creates or Updates Selected Object. Action creates a single object.
-
Object - Input field where you should choose the object type, which you want to find. E.g.
Account
-
Type Of Search - Dropdown list with values:
Unique Fields
,All Fields
andExternal IDs
All Fields
- all available fields in the objectUnique Fields
- fields wheretype
isid
orunique
istrue
External IDs
- fields whereexternalId
istrue
, this option uses built-in salesforce method upsert.
It works as following:
- If there is no value in the lookup field - a new object will be created
- If a lookup value is specified and
External IDs
selected as a Type Of Search - it is the most efficient (fast) way to go. In this case an object will be upserted directly on the Salesforce side. When this field has an attributeUnique
it would guarantee that no errors are emitted. - If a lookup value is specified and one of
Unique Fields
orAll Fields
selected - then an action will first lookup for an existing object in Salesforce:- If no objects found - a new one will be created
- If 1 object found - it will be updated
- If more than 1 object found - ar error
Found more than 1 Object
will be thrown
-
Lookup by field - Dropdown list with fields on the selected object, depending on the Type Of Search
- lookup by - name of filed selected in 'Lookup by field'
- other fields, that used by selected Object
The result of creating or updating an object
- id - Unic identificator from salesforce
- success - Boolean result of creation/update object
- errors - Arrey of errors if they exist
If you add a new field to an object in Salesforce, you must restart the flow to re-generate metadata
By default, certain user profiles in Salesforce have disabled permissions. In order to ensure the visibility of an object in the metadata of component’s actions and triggers, it is necessary to enable the required standard object permissions.
To enable these permissions, please follow these steps:
- Go to the Salesforce Setup page.
- Navigate to the “ADMINISTRATION” section.
- Under “Profiles”, select the profile that needs modification.
- Click on the “Edit” button to proceed.
Salesforse setup page
![image](https://github.com/elasticio/salesforce-component-v2/assets/108279772/ad2b7d68-c843-4356-92b3-7650bab6a3f2)Once you are on the profile editing page, ensure that all the required standard object permissions are enabled. For instance, if you intend to utilize the Get New and Updated Objects Polling trigger, the following permissions are necessary: Read, Create, and Edit.
Standart objects permissions
![image](https://github.com/elasticio/salesforce-component-v2/assets/108279772/f80445e4-098a-42cf-a728-6a204b8e7329)Carefully review the permissions and make any necessary adjustments to enable the required access.
Attachments mechanism does not work with Local Agent Installation