# Step-Functions reduce lambda size code

**URL:** <https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740>\
**Category:** Serverless Framework\
**Tags:** aws\
**Created:** [April 20, 2017, 1:06pm UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740 "2017-04-20T13:06:17Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![khinester](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/khinester/32/315_2.png) [@khinester](https://forum.serverless.com/u/khinester)\
**Post date:** [April 20, 2017, 1:06pm UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/1 "2017-04-20T13:06:17Z")

</div>

Hello,  
I have a step-function running, but the size of each lambda is exactly the same and I am now getting the error `Code storage limit exceeded` when i try to deploy this.

my setup is:

```
➜ ingest git:(feature/ingest) ✗ tree -L 2 (git)-[feature/ingest] 
.
├── authorization
│ └── index.js
├── balance
│ └── index.js
├── config.js
├── dynamodb
│ └── index.js
├── execute_steps
│ └── index.js
├── ffprobe
│ └── index.js
├── get_assembly
│ └── index.js
├── index
│ └── index.js
├── Makefile
├── node_modules
│ ├── acorn
...
│ └── yargs-parser
├── package.json
├── README.md
├── serverless.yml
├── transloadit
│ └── index.js
├── upload
│ └── index.js
├── waiting_user_choice
│ └── index.js
└── yarn.lock

```

So I have about 8 lambda function in this step-function - what is the correct way to deploy this and reduce the size of each of the function?

Any advice is much appreciated.

---

<div class="post-metadata">

**Author:** ![rowanu](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/rowanu/32/75_2.png) [@rowanu](https://forum.serverless.com/u/rowanu)\
**Post date:** [April 20, 2017, 10:41pm UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/2 "2017-04-20T22:41:22Z")

</div>

It doesn’t sound like you’re [packaging](https://serverless.com/framework/docs/providers/aws/guide/packaging/) your functions individually.

Keep in mind too that the packaging settings changed in the [v1.11 release](https://serverless.com/blog/serverless-v1.11.0/).

---

<div class="post-metadata">

**Author:** ![khinester](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/khinester/32/315_2.png) [@khinester](https://forum.serverless.com/u/khinester)\
**Post date:** [April 21, 2017, 7:37am UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/3 "2017-04-21T07:37:34Z")

</div>

In my project the `node_modules` and `package.json` is in the root of the project and when adding the:

```
package:
  individually: true

```

to the `serverless.yaml`, the deploy command hangs on `Uploading function .zip files to S3...`:

```
➜ ingest git:(feature/ingest) ✗ yarn deploy-dev (git)-[feature/ingest] 
yarn deploy-dev v0.22.0
$ rm -rf node_modules && yarn install --production && AWS_PROFILE=dev sls deploy --stage dev --region us-east-1 
yarn install v0.22.0
[1/4] Resolving packages...
[2/4] Fetching packages...
[3/4] Linking dependencies...
[4/4] Building fresh packages...
Done in 4.28s.
Serverless: Packaging service...
Serverless: Uploading CloudFormation file to S3...
Serverless: Uploading function .zip files to S3...

```

would I have to for each function, exclude node\_modules and then individually include the modules needed for the specific function as per [https://serverless.com/framework/docs/providers/aws/guide/packaging/#examples](https://serverless.com/framework/docs/providers/aws/guide/packaging/#examples) ?

---

<div class="post-metadata">

**Author:** ![rowanu](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/rowanu/32/75_2.png) [@rowanu](https://forum.serverless.com/u/rowanu)\
**Post date:** [April 21, 2017, 8:03am UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/4 "2017-04-21T08:03:20Z")

</div>

Unfortunately yes, you would.

For more complex functions (i.e. those with many dependencies) I usually have a subdirectory per function, and can then package it by directory.

If you are going to do it off a shared `node_modules` directory, I suggest you use the `--legacy-bundling` option. From [the docs](https://docs.npmjs.com/cli/install):

> The --legacy-bundling argument will cause npm to install the package such that versions of npm prior to 1.4, such as the one included with node 0.8, can install the package. This eliminates all automatic deduping.

This means each module will have all of its dependencies contained in its own directory.

---

<div class="post-metadata">

**Author:** ![khinester](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/khinester/32/315_2.png) [@khinester](https://forum.serverless.com/u/khinester)\
**Post date:** [April 21, 2017, 8:39am UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/5 "2017-04-21T08:39:22Z")

</div>

cool, this works:

```
plugins:
  - serverless-step-functions
package:
  individually: true
  exclude:
    - yarn.lock
    - .git/*
functions:
  getSignedUrl:
    handler: authorization/index.getSignedUrl
    package:
      exclude:
        - node_modules/**
        - '!node_modules/jsonwebtoken/**'
        - '!node_modules/aws-sdk/**'
        - '!node_modules/moment/**'
        - '!node_modules/uuid/**'
    events:
      - http:
          path: get-upload-url
          method: post
          integration: lambda

```

for the `getSignedUrl` will include only:

```
        - '!node_modules/jsonwebtoken/**'
        - '!node_modules/aws-sdk/**'
        - '!node_modules/moment/**'
        - '!node_modules/uuid/**'

```

but @rowanu how do you deal with the included module’s dependancies as those will need to also be included?

---

<div class="post-metadata">

**Author:** ![rowanu](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/rowanu/32/75_2.png) [@rowanu](https://forum.serverless.com/u/rowanu)\
**Post date:** [April 21, 2017, 8:36pm UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/6 "2017-04-21T20:36:42Z")

</div>

That’s what the `--legacy-bundling` argument does - it installs a module’s dependencies in the module’s directory.

---

<div class="post-metadata">

**Author:** ![buggy](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/buggy/32/177_2.png) [@buggy](https://forum.serverless.com/u/buggy)\
**Post date:** [April 22, 2017, 10:16am UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/7 "2017-04-22T10:16:44Z")

</div>

Another thing you can look at is moving your dev dependencies into a `node_modules` in the parent directory (the one above your service folder). They’ll still be available to Serverless but they won’t be packaged with your code. While it won’t help you with having the smallest possible package for each function it is a quick win to remove packages like the aws-sdk, compilers/transpilers, test frameworks, plugins (and their dependencies).

---

<div class="post-metadata">

**Author:** ![khinester](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/khinester/32/315_2.png) [@khinester](https://forum.serverless.com/u/khinester)\
**Post date:** [April 22, 2017, 12:36pm UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/8 "2017-04-22T12:36:22Z")

</div>

that is a good idea, to move dev dependencies, thanks and yes using --legacy-bundling does fix the issue. I am using the `aws-sdk` in my functions to access dynamoDB and S3 - is there an alternative way to package these?

---

<div class="post-metadata">

**Author:** ![buggy](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/buggy/32/177_2.png) [@buggy](https://forum.serverless.com/u/buggy)\
**Post date:** [April 23, 2017, 3:18am UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/9 "2017-04-23T03:18:03Z")

</div>

See the docs [Lambda runtimes - AWS Lambda](http://docs.aws.amazon.com/lambda/latest/dg/current-supported-versions.html)

> The following libraries are available in the AWS Lambda execution environment, regardless of the supported runtime you use, so you don’t need to include them:
> 
> - AWS SDK – AWS SDK for JavaScript version 2.22.0
> - AWS SDK for Python (Boto 3) version 1.4.4, Botocore version 1.5.13
> - Amazon Linux build of java-1.8.0-openjdk for Java.

If you can limit yourself the currently included version then there’s no need to include it in the upload package to use it.

---

<div class="post-metadata">

**Author:** ![khinester](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.serverless.com/khinester/32/315_2.png) [@khinester](https://forum.serverless.com/u/khinester)\
**Post date:** [April 24, 2017, 10:37am UTC](https://forum.serverless.com/t/step-functions-reduce-lambda-size-code/1740/10 "2017-04-24T10:37:19Z")

</div>

Hi, thanks for the replies. I have one issue, which I find strange, in that, if I enable the `individually: true` for a specific function, as:

```
  choiceStart:
    handler: execute_steps/index.executeSteps
    # package:
    # individually: true
    # exclude:
    # - node_modules/**
    # - '!node_modules/jsonwebtoken/**'
    # - '!node_modules/request/**'
    events:
      - http:
          path: choice-start
          method: post
          integration: lambda

```

I get an error about missing module:

```
START RequestId: 09714a20-26cd-11e7-9dc5-4f7f268fbac2 Version: $LATEST
Unable to import module 'execute_steps/index': Error
    at Function.Module._resolveFilename (module.js:469:15)
    at Function.Module._load (module.js:417:25)
    at Module.require (module.js:497:17)
    at require (internal/module.js:20:19)
    at Object.<anonymous> (/var/task/node_modules/jsonwebtoken/node_modules/joi/lib/date.js:7:14)
    at Module._compile (module.js:570:32)
    at Object.Module._extensions..js (module.js:579:10)
    at Module.load (module.js:487:32)
    at tryModuleLoad (module.js:446:12)
    at Function.Module._load (module.js:438:3)
END RequestId: 09714a20-26cd-11e7-9dc5-4f7f268fbac2
REPORT RequestId: 09714a20-26cd-11e7-9dc5-4f7f268fbac2	Duration: 57.48 ms	Billed Duration: 100 ms Memory Size: 128 MB	Max Memory Used: 25 MB	

```

I deploy my function as:

`$ rm -rf node_modules && npm install --production --legacy-bundling && AWS_PROFILE=dev sls deploy --stage dev --region us-east-1`

otherwise it works, if i comment the `package` block.

i have checked the function code, and I am only using `aws-sdk`, `request` and `jsonwebtoken` within it.

any advice is much appreciated