{"id":1175,"date":"2021-04-13T07:47:24","date_gmt":"2021-04-13T05:47:24","guid":{"rendered":"https:\/\/www.netexpertise.eu\/en\/?p=1175"},"modified":"2021-08-24T19:32:04","modified_gmt":"2021-08-24T17:32:04","slug":"make-ansible-6x-faster-with-these-3-tips","status":"publish","type":"post","link":"http:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html","title":{"rendered":"Make Ansible 6X Faster with these 3 Tips"},"content":{"rendered":"\n

Ansible<\/a> is generally slow because it connects to the remote host for every task it runs. Let’s do some checks on a tiny role that gets the latest kubectl version (Kubernetes client) from a URL and installs the binary.
Let’s see 3 easy ways how to speed up Ansible and get better execution times and overall performance.

<\/p>\n\n\n\n

- name: get kubectl last version\n   uri:\n     url: \"{{kubectl_url}}\/stable.txt\"\n     return_content: yes\n     status_code: 200\n   register: kubectl_latest_version\n \n\n - name: Download kubectl binary\n   get_url:\n     url: \"{{kubectl_url}}\/v{{ kubectl_version |\n       default(kubectl_latest_version.content | \n       regex_replace('^v', '')) }}\/bin\/{{kubectl_os}}\/{{kubectl_arch}}\/kubectl\"\n     dest: \"\/usr\/local\/bin\"\n     mode: '755'\n     owner: \"{{ kubectl_owner }}\"\n     group: \"{{ kubectl_group }}\"<\/code><\/pre>\n\n\n\n

Execution time with default settings: 32,2s<\/strong><\/span>

<\/p>\n\n\n\n
\"Ansible<\/a>
Speed up Ansible<\/figcaption><\/figure><\/div>\n\n\n\n

Ansible Fact Cache<\/h2>\n\n\n\n
Gathering facts is the first task Ansible runs when connecting to a host and the least we can say, it is slow. Very slow. Performance is also an issue when writing a playbook that you are testing over and over.

Luckily, it can be tweaked to save some time by adding these lines in ansible.cfg:<\/p>\n\n\n\n
# implement fact caching and a smaller subset of facts gathered \n# for improved performance\n\ngathering = smart\ngather_subset = !hardware,!facter,!ohai\n\nfact_caching_connection = \/tmp\/ansible_fact_cache\nfact_caching = jsonfile\n\n# expire the fact cache after 2 hours\nfact_caching_timeout = 7200<\/code><\/pre>\n\n\n\n

According to the ansible.cfg<\/a> example available online, smart gathering “gathers by default, but doesn’t regather if already gathered”.

Hardware facts are the longest facts to retrieve but you may need them especially if you build roles based on network interfaces. You may get “ansible_eth0 is undefined” for example.
Facter and ohai are related to Puppet and Chef clients.

And the most efficient is fact caching of course that stores information in a JSON file. But it could also fit in memory, or even in a shared Redis database.<\/p>\n\n\n\n
Facts can also be disabled within a playbook if you don’t need them for that specific playbook. That’s a potential significant speed up that you can’t use too often though, most playbooks need facts.<\/p>\n\n\n\n
- name: my_playbook\n    hosts: *\n    gather_facts: no\n    tasks:<\/code><\/pre>\n\n\n\n

Execution time: 19,2s<\/strong><\/span><\/p>\n\n\n\n

SSH Speedup with Pipelining<\/h2>\n\n\n\n
Enabling pipelining reduces the number of SSH operations required to execute a module on the remote server. This improves performance but ‘requiretty’ must first be disabled in \/etc\/sudoers on all managed hosts, reason why pipelining is disabled by default. Add in ansible.cfg:<\/p>\n\n\n\n
[ssh_connection]\npipelining = True<\/code><\/pre>\n\n\n\n

If requiretty is set, sudo will only run when the user is logged in to a real tty.  When this flag is set, sudo can only be run from a login session and not via other means such as cron or cgi-bin scripts. However, this flag is off by default according to the man page on Debian and Ubuntu at least.
It is safe to use pipelining is this case. Check your Linux distro sudo man page.

Execution time: 11,6s<\/span><\/strong>

<\/p>\n\n\n\n
Delegate_to localhost<\/h2>\n\n\n\n
Most improvements are dependant on the way you write Ansible tasks. In this role, you could connect to the URL from any host – localhost? – and spare an SSH connection.
This is the purpose of delegate_to<\/em> that is usually set to localhost. The first task becomes:<\/p>\n\n\n\n
- name: get kubectl last version\n   delegate_to: localhost\n   become: false\n   uri:\n     url: \"{{kubectl_url}}\/stable.txt\"\n     return_content: yes\n     status_code: 200\n   register: kubectl_latest_version<\/code><\/pre>\n\n\n\n

This is a non neglectable optimisation that you can use anytime the task can be run anywhere.

You’d better set become: false<\/em> or you might get this error message if Ansible tries to sudo as root on your local host.<\/p>\n\n\n\n
fatal: [backup]: FAILED! => {\"changed\": false, \"module_stderr\": \"sudo: a password is required\\n\", \"module_stdout\": \"\", \"msg\": \"MODULE FAILURE\\nSee stdout\/stderr for the exact error\", \"rc\": 1}<\/code><\/pre>\n\n\n\n

Execution time: 4,7s<\/strong><\/span><\/p>\n\n\n\n

Execution time is the mean time of 10 runs in a row, and tests were conducted through a VPN link that was far from good.

Of course, results are not linear, all playbooks will not run 6 times faster every time but you get the idea. Fact cache saves a few seconds at the start of the playbook while delegation to localhost is only applicable to a small bunch of cases.
There are other possible improvements to speed up Ansible such as async<\/a> tasks to launch a task and move on immediately to the next one, but your best bet is to run Ansible on a server as close as possible to the target hosts, because people often experience slow SSH connections.<\/p>\n","protected":false},"excerpt":{"rendered":"
Speed up Ansible with 3 easy tweaks and more<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0},"categories":[427],"tags":[429],"yoast_head":"\nNetexpertise - Make Ansible 6X Faster with these 3 Tips<\/title>\n<meta name=\"description\" content=\"Ansible is slow at times? Speed up Ansible with 3 easy tweaks and other performance optimisations to make it faster\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Netexpertise - Make Ansible 6X Faster with these 3 Tips\" \/>\n<meta property=\"og:description\" content=\"Ansible is slow at times? Speed up Ansible with 3 easy tweaks and other performance optimisations to make it faster\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html\" \/>\n<meta property=\"og:site_name\" content=\"Netexpertise\" \/>\n<meta property=\"article:published_time\" content=\"2021-04-13T05:47:24+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-08-24T17:32:04+00:00\" \/>\n<meta name=\"author\" content=\"dave\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@netexpertise\" \/>\n<meta name=\"twitter:site\" content=\"@netexpertise\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html\",\"url\":\"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html\",\"name\":\"Netexpertise - Make Ansible 6X Faster with these 3 Tips\",\"isPartOf\":{\"@id\":\"https:\/\/www.netexpertise.eu\/en\/#website\"},\"datePublished\":\"2021-04-13T05:47:24+00:00\",\"dateModified\":\"2021-08-24T17:32:04+00:00\",\"author\":{\"@id\":\"https:\/\/www.netexpertise.eu\/en\/#\/schema\/person\/cb4cd666549d22e9070ec1cfc1a496fa\"},\"description\":\"Ansible is slow at times? Speed up Ansible with 3 easy tweaks and other performance optimisations to make it faster\",\"breadcrumb\":{\"@id\":\"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.netexpertise.eu\/en\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Make Ansible 6X Faster with these 3 Tips\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.netexpertise.eu\/en\/#website\",\"url\":\"https:\/\/www.netexpertise.eu\/en\/\",\"name\":\"Netexpertise\",\"description\":\"Systems \/ Networks \/ DevOps\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.netexpertise.eu\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.netexpertise.eu\/en\/#\/schema\/person\/cb4cd666549d22e9070ec1cfc1a496fa\",\"name\":\"dave\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.netexpertise.eu\/en\/#\/schema\/person\/image\/\",\"url\":\"http:\/\/1.gravatar.com\/avatar\/1129916e1f4955bd632f27f836f64e55?s=96&d=mm&r=g\",\"contentUrl\":\"http:\/\/1.gravatar.com\/avatar\/1129916e1f4955bd632f27f836f64e55?s=96&d=mm&r=g\",\"caption\":\"dave\"},\"sameAs\":[\"http:\/\/www.netexpertise.eu\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Netexpertise - Make Ansible 6X Faster with these 3 Tips","description":"Ansible is slow at times? Speed up Ansible with 3 easy tweaks and other performance optimisations to make it faster","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html","og_locale":"en_US","og_type":"article","og_title":"Netexpertise - Make Ansible 6X Faster with these 3 Tips","og_description":"Ansible is slow at times? Speed up Ansible with 3 easy tweaks and other performance optimisations to make it faster","og_url":"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html","og_site_name":"Netexpertise","article_published_time":"2021-04-13T05:47:24+00:00","article_modified_time":"2021-08-24T17:32:04+00:00","author":"dave","twitter_card":"summary_large_image","twitter_creator":"@netexpertise","twitter_site":"@netexpertise","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html","url":"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html","name":"Netexpertise - Make Ansible 6X Faster with these 3 Tips","isPartOf":{"@id":"https:\/\/www.netexpertise.eu\/en\/#website"},"datePublished":"2021-04-13T05:47:24+00:00","dateModified":"2021-08-24T17:32:04+00:00","author":{"@id":"https:\/\/www.netexpertise.eu\/en\/#\/schema\/person\/cb4cd666549d22e9070ec1cfc1a496fa"},"description":"Ansible is slow at times? Speed up Ansible with 3 easy tweaks and other performance optimisations to make it faster","breadcrumb":{"@id":"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.netexpertise.eu\/en\/devops\/ansible\/make-ansible-6x-faster-with-these-3-tips.html#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.netexpertise.eu\/en"},{"@type":"ListItem","position":2,"name":"Make Ansible 6X Faster with these 3 Tips"}]},{"@type":"WebSite","@id":"https:\/\/www.netexpertise.eu\/en\/#website","url":"https:\/\/www.netexpertise.eu\/en\/","name":"Netexpertise","description":"Systems \/ Networks \/ DevOps","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.netexpertise.eu\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.netexpertise.eu\/en\/#\/schema\/person\/cb4cd666549d22e9070ec1cfc1a496fa","name":"dave","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.netexpertise.eu\/en\/#\/schema\/person\/image\/","url":"http:\/\/1.gravatar.com\/avatar\/1129916e1f4955bd632f27f836f64e55?s=96&d=mm&r=g","contentUrl":"http:\/\/1.gravatar.com\/avatar\/1129916e1f4955bd632f27f836f64e55?s=96&d=mm&r=g","caption":"dave"},"sameAs":["http:\/\/www.netexpertise.eu"]}]}},"_links":{"self":[{"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/posts\/1175"}],"collection":[{"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/comments?post=1175"}],"version-history":[{"count":0,"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/posts\/1175\/revisions"}],"wp:attachment":[{"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/media?parent=1175"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/categories?post=1175"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.netexpertise.eu\/en\/wp-json\/wp\/v2\/tags?post=1175"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}