{"id":31373,"date":"2024-10-10T12:38:00","date_gmt":"2024-10-10T07:08:00","guid":{"rendered":"https:\/\/mobisoftinfotech.com\/resources\/?p=31373"},"modified":"2025-10-16T13:02:02","modified_gmt":"2025-10-16T07:32:02","slug":"processing-aws-alb-logs-goaccess-excel-sqlite","status":"publish","type":"post","link":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite","title":{"rendered":"Processing AWS ALB Logs with GoAccess, Excel, and SQLite"},"content":{"rendered":"<h2 class=\"wp-block-heading\">Introduction<\/h2>\n\n\n\n<p>Sometimes on projects with tight budgets we don&#8217;t have access to expensive APM tools like DataDog and New Relic. In such projects, there is no easy way to find out which of the APIs are slow causing performance issues for your application. In such cases, processing AWS Application Load Balancer logs which (if enabled) are stored in a S3 bucket can lead to valuable insights.<\/p>\n\n\n\n<p>This tutorial walks you through the process of downloading Application Load Balancer logs from AWS S3, consolidating them, and analyzing them using tools like <strong>GoAccess<\/strong>, <strong>Excel<\/strong>, and <strong>SQLite<\/strong>. By the end of this guide, you&#8217;ll be able to extract meaningful metrics and identify slow requests or errors impacting your application&#8217;s performance.<\/p>\n\n\n\n<p>You will need:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>AWS CLI<\/strong> configured with the necessary permissions to access your Application Load Balancer logs in S3. You can get it from <a href=\"https:\/\/docs.aws.amazon.com\/cli\/latest\/userguide\/getting-started-install.html\">here<\/a>.<\/li>\n\n\n\n<li><strong>GoAccess<\/strong> installed on your local machine for log analysis. You can get it from <a href=\"https:\/\/goaccess.io\/download\">here<\/a><\/li>\n\n\n\n<li><strong>SQLite3<\/strong> installed for querying log data. On all modern Linux and Mac machines SQLite should be available by default. If you are using Windows, please use <a href=\"https:\/\/www.freecodecamp.org\/news\/how-to-install-wsl2-windows-subsystem-for-linux-2-on-windows-10\/\">WSL2<\/a> follow this tutorial.<\/li>\n\n\n\n<li><strong>Excel<\/strong>: Excel or any spreadsheet software for additional data manipulation.<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/mobisoftinfotech.com\/services\/devops?utm_source=blog&amp;utm_medium=referral&amp;utm_campaign=processing-aws-alb-logs-goaccess-excel-sqlite-cta1\"><noscript><img decoding=\"async\" width=\"855\" height=\"120\" src=\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/optimize-aws-infrastructure-devops-solutions-cta.png\" alt=\"Optimize Your AWS Infrastructure with Expert DevOps Solutions\" class=\"wp-image-31384\" title=\"Optimize AWS Infrastructure with DevOps Solutions\"><\/noscript><img decoding=\"async\" width=\"855\" height=\"120\" src=\"data:image\/svg+xml,%3Csvg%20xmlns%3D%22http%3A%2F%2Fwww.w3.org%2F2000%2Fsvg%22%20viewBox%3D%220%200%20855%20120%22%3E%3C%2Fsvg%3E\" alt=\"Optimize Your AWS Infrastructure with Expert DevOps Solutions\" class=\"wp-image-31384 lazyload\" title=\"Optimize AWS Infrastructure with DevOps Solutions\" data-src=\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/optimize-aws-infrastructure-devops-solutions-cta.png\"><\/a><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Step 1: Configure AWS CLI and Download the Logs<\/h2>\n\n\n\n<p>First, ensure your AWS CLI is configured correctly:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">aws configure<\/pre>\n\n\n\n<p>Provide your AWS Access Key ID, Secret Access Key, Default Region, and Default Output Format when prompted.<\/p>\n\n\n\n<p>Next, synchronize your Application Load Balancer logs from the S3 bucket to a local directory:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">aws s3 sync s3:\/\/your-alb-logs-bucket\/path\/to\/logs .\/alb-logs<\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Replace <code>s3:\/\/your-alb-logs-bucket\/path\/to\/logs<\/code> with the actual S3 path to your Application Load Balancer logs.<\/li>\n\n\n\n<li><code>.\/alb-logs<\/code> is the local directory where the logs will be downloaded.<\/li>\n<\/ul>\n\n\n\n<p><strong>Note:<\/strong> The logs will be downloaded into a nested directory structure organized by year, month, and day.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h2 class=\"wp-block-heading\">Step 2: Consolidate Log Files<\/h2>\n\n\n\n<p>To simplify processing, it&#8217;s helpful to move all <code>.log.gz<\/code> files into a single directory.<\/p>\n\n\n\n<p>Navigate to your logs directory:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">cd alb-logs<\/pre>\n\n\n\n<p>Use the following command to find and move all <code>.log.gz<\/code> files to the current directory:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">find . -type f -name \"*.log.gz\" -exec mv {} . \\;<\/pre>\n\n\n\n<p><strong>Explanation:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>find .<\/code>: Searches in the current directory and subdirectories.<\/li>\n\n\n\n<li><code>-type f<\/code>: Looks for files.<\/li>\n\n\n\n<li><code>-name \"*.log.gz\"<\/code>: Matches files ending with <code>.log.gz<\/code>.<\/li>\n\n\n\n<li><code>-exec mv {} . \\;<\/code>: Executes the <code>mv<\/code> command to move each found file to the current directory.<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h2 class=\"wp-block-heading\">Step 3: Combine Logs into a Single File<\/h2>\n\n\n\n<p>Unzip and combine all log files into one file for easier processing:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">gunzip -c *.log.gz &gt; combined-log.txt<\/pre>\n\n\n\n<p><strong>Explanation:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>gunzip -c<\/code>: Unzips the files and outputs to stdout.<\/li>\n\n\n\n<li><code>*.log.gz<\/code>: Matches all compressed log files.<\/li>\n\n\n\n<li><code>&gt; combined-log.txt<\/code>: Redirects the output to <code>combined-log.txt<\/code>.<\/li>\n<\/ul>\n\n\n\n<p><strong>Optional:<\/strong> Check the number of log lines:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">cat combined-log.txt | wc -l<\/pre>\n\n\n\n<p>This command counts the number of lines in the combined log file, giving you an idea of the volume of data you&#8217;re working with.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h2 class=\"wp-block-heading\">Step 4: Analyze Logs with GoAccess<\/h2>\n\n\n\n<p>Use GoAccess to parse and analyze the combined log file:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">cat combined-log.txt | goaccess --log-format=AWSELB -a -o report.html<\/pre>\n\n\n\n<p><strong>Explanation:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>cat combined-log.txt<\/code>: Outputs the content of the combined log file.<\/li>\n\n\n\n<li><code>|<\/code>: Pipes the output to the next command.<\/li>\n\n\n\n<li><code>goaccess --log-format=AWSELB -a -o report.html<\/code>: Runs GoAccess with the AWS ELB log format, enables all static reports (<code>-a<\/code>), and outputs the report to <code>report.html<\/code>.<\/li>\n<\/ul>\n\n\n\n<p><strong>View the Report:<\/strong><\/p>\n\n\n\n<p>Open <code>report.html<\/code> in your web browser to explore the visual analytics provided by GoAccess.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h2 class=\"wp-block-heading\">Step 5: Prepare Logs for CSV Processing<\/h2>\n\n\n\n<p>Replace spaces with tabs to convert the log file into a tab-separated values (TSV) format suitable for CSV processing:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">sed -e 's\/ \/\\t\/g' combined-log.txt &gt; combined-log.tsv<\/pre>\n\n\n\n<p><strong>Explanation:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>sed -e 's\/ \/\\t\/g'<\/code>: Uses <code>sed<\/code> to substitute every space with a tab character.<\/li>\n\n\n\n<li><code>combined-log.txt<\/code>: Input file.<\/li>\n\n\n\n<li><code>&gt; combined-log.tsv<\/code>: Redirects the output to <code>combined-log.tsv<\/code>.<\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h2 class=\"wp-block-heading\">Step 6: Sort Logs by Target Response Time<\/h2>\n\n\n\n<p>Identify the slowest requests by sorting the logs based on the <code>target_processing_time<\/code> field:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">sort -k7nr combined-log.tsv | head -200 &gt; top-slow-200.tsv<\/pre>\n\n\n\n<p><strong>Explanation:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>sort -k7nr combined-log.tsv<\/code>: Sorts the TSV file numerically (<code>n<\/code>) and in reverse order (<code>r<\/code>) based on the 7th column (<code>k7<\/code>), which corresponds to <code>target_processing_time<\/code>.<\/li>\n\n\n\n<li><code>| head -200<\/code>: Takes the top 200 entries from the sorted output.<\/li>\n\n\n\n<li><code>&gt; top-slow-200.tsv<\/code>: Writes the result to <code>top-slow-200.tsv<\/code>.<\/li>\n<\/ul>\n\n\n\n<p><strong>Note:<\/strong> The column index starts at 1, so <code>k7<\/code> refers to the 7th column.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h2 class=\"wp-block-heading\">Step 7: Load Logs into SQLite Database<\/h2>\n\n\n\n<p>Loading the TSV data into SQLite allows for powerful querying capabilities.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Create a SQLite Database and Table<\/strong><\/h3>\n\n\n\n<p>Create a new SQLite database:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">sqlite3 logs.db<\/pre>\n\n\n\n<p>Within the SQLite shell, create a <code>logs<\/code> table matching the AWS Application Load Balancer log fields:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">CREATE TABLE logs (\n    type TEXT,\n    time TEXT,\n    elb TEXT,\n    client_port TEXT,\n    target_port TEXT,\n    request_processing_time REAL,\n    target_processing_time REAL,\n    response_processing_time REAL,\n    elb_status_code INTEGER,\n    target_status_code INTEGER,\n    received_bytes INTEGER,\n    sent_bytes INTEGER,\n    request TEXT,\n    user_agent TEXT,\n    ssl_cipher TEXT,\n    ssl_protocol TEXT,\n    target_group_arn TEXT,\n    trace_id TEXT,\n    domain_name TEXT,\n    chosen_cert_arn TEXT,\n    matched_rule_priority INTEGER,\n    request_creation_time TEXT,\n    actions_executed TEXT,\n    redirect_url TEXT,\n    error_reason TEXT,\n    target_port_list TEXT,\n    target_status_code_list TEXT,\n    classification TEXT,\n    classification_reason TEXT,\n    conn_trace_id TEXT\n);<\/pre>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Configure SQLite for TSV Import<\/strong><\/h3>\n\n\n\n<p>Set the separator to a tab character and switch to tab-separated mode:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">.separator \"\\t\"\n.mode tabs<\/pre>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Import the TSV Data<\/strong><\/h3>\n\n\n\n<p>Import the data from <code>combined-log.tsv<\/code> into the <code>logs<\/code> table:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">.import combined-log.tsv logs<\/pre>\n\n\n\n<p><strong>Note:<\/strong> Ensure that <code>combined-log.tsv<\/code> is in the same directory as your SQLite database or provide the full path.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Query the Data<\/strong><\/h3>\n\n\n\n<p>Set the output mode to CSV and specify an output file:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">.mode csv\n.output slow-requests.csv<\/pre>\n\n\n\n<p>Execute a query to find requests with a <code>target_processing_time<\/code> greater than 10 seconds:<\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">SELECT time, target_processing_time, request\nFROM logs\nWHERE target_processing_time &gt; 10\nORDER BY target_processing_time DESC\nLIMIT 40;<\/pre>\n\n\n\n<p>This query selects the timestamp, target processing time, and request details for the top 40 slowest requests.<\/p>\n\n\n\n<p><strong>Reset Output and Exit SQLite:<\/strong><\/p>\n\n\n\n<pre class=\"wp-block-syntaxhighlighter-code\">.mode list\n.quit<\/pre>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\">\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>This process enables you to find out which of the endpoints are slow and are causing performance issues. Then you can investigate those endpoints further. Hope you found this tutorial helpful. If yes, please share it with your friends and colleagues.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/mobisoftinfotech.com\/services\/cloud-development?utm_source=blog&amp;utm_medium=referral&amp;utm_campaign=processing-aws-alb-logs-goaccess-excel-sqlite-cta2\"><noscript><img decoding=\"async\" width=\"855\" height=\"120\" src=\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/enhance-cloud-performance-scalable-solutions-cta.png\" alt=\"Enhance Your Cloud Performance with Scalable Cloud Solutions\" class=\"wp-image-31381\" title=\"Enhance Cloud Performance with Scalable Cloud Solutions\"><\/noscript><img decoding=\"async\" width=\"855\" height=\"120\" src=\"data:image\/svg+xml,%3Csvg%20xmlns%3D%22http%3A%2F%2Fwww.w3.org%2F2000%2Fsvg%22%20viewBox%3D%220%200%20855%20120%22%3E%3C%2Fsvg%3E\" alt=\"Enhance Your Cloud Performance with Scalable Cloud Solutions\" class=\"wp-image-31381 lazyload\" title=\"Enhance Cloud Performance with Scalable Cloud Solutions\" data-src=\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/enhance-cloud-performance-scalable-solutions-cta.png\"><\/a><\/figure>\n\n\n<div class=\"related-posts-section\"><h2>Related Posts<\/h2><ul class=\"related-posts-list\"><li><a href=\"https:\/\/mobisoftinfotech.com\/resources\/blog\/covid-vaccine-equity-enhances-care-delivery\">Creating COVID Vaccine Equity to Enhance Community Care Coordination<\/a><\/li><li><a href=\"https:\/\/mobisoftinfotech.com\/resources\/blog\/how-to-promote-your-mobile-app\">How to Promote Your Mobile App?<\/a><\/li><li><a href=\"https:\/\/mobisoftinfotech.com\/resources\/blog\/ai-event-transportation-case-studies-future-trends\">Glimpse Into The Future Of Event Transportation With AI: Real Case Studies<\/a><\/li><li><a href=\"https:\/\/mobisoftinfotech.com\/resources\/blog\/big-data-in-healthcare-industry\">How Big Data is Changing the Healthcare Industry?<\/a><\/li><li><a href=\"https:\/\/mobisoftinfotech.com\/resources\/blog\/health-information-exchange-benefits-and-challenges\">7 Benefits of Health Information Exchange (HIE) With Potential Challenges?<\/a><\/li><li><a href=\"https:\/\/mobisoftinfotech.com\/resources\/blog\/field-management-services-for-sales-team\">Why Is Field Management Services (FMS) a Competitive Differentiator for Your Sales Team?<\/a><\/li><\/ul><\/div>\n\n\n<div class=\"modern-author-card\">\n    <div class=\"author-card-content\">\n        <div class=\"author-info-section\">\n            <div class=\"author-avatar\">\n                <noscript><img decoding=\"async\" src=\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2022\/04\/Pritam1.jpg\" alt=\"Pritam Barhate\"><\/noscript><img decoding=\"async\" src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7\" alt=\"Pritam Barhate\" data-src=\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2022\/04\/Pritam1.jpg\" class=\" lazyload\">\n            <\/div>\n            <div class=\"author-details\">\n                <h3 class=\"author-name\">Pritam Barhate<\/h3>\n                <p class=\"author-title\">Head of Technology Innovation<\/p>\n                <a href=\"javascript:void(0);\" class=\"read-more-link read-more-btn\" onclick=\"toggleAuthorBio(this); return false;\">Read more <noscript><img decoding=\"async\" src=\"\/assets\/images\/blog\/Vector.png\" alt=\"expand\" class=\"read-more-arrow down-arrow\"><\/noscript><img decoding=\"async\" src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7\" alt=\"expand\" class=\"read-more-arrow down-arrow lazyload\" data-src=\"\/assets\/images\/blog\/Vector.png\"><\/a>\n                <div class=\"author-bio-expanded\">\n                    <p>Pritam Barhate, with an experience of 14+ years in technology, heads Technology Innovation at <a href=\"https:\/\/mobisoftinfotech.com\" target=\"_blank\" rel=\"noopener\">Mobisoft Infotech<\/a>. He has a rich experience in design and development. He has been a consultant for a variety of industries and startups. At Mobisoft Infotech, he primarily focuses on technology resources and develops the most advanced solutions.<\/p>\n                    <div class=\"author-social-links\">\n                        <div class=\"social-icon\">\n                            <a href=\"https:\/\/www.linkedin.com\/in\/pritam-barhate-90b93414\/\" target=\"_blank\" rel=\"nofollow noopener\"><i class=\"icon-sprite linkedin\"><\/i><\/a>\n                            <a href=\"https:\/\/twitter.com\/pritambarhate\" target=\"_blank\" rel=\"nofollow noopener\"><i class=\"icon-sprite twitter\"><\/i><\/a>\n                        <\/div>\n                    <\/div>\n                    <a href=\"javascript:void(0);\" class=\"read-more-link read-less-btn\" onclick=\"toggleAuthorBio(this); return false;\" style=\"display: none;\">Read less <noscript><img decoding=\"async\" src=\"\/assets\/images\/blog\/Vector.png\" alt=\"collapse\" class=\"read-more-arrow up-arrow\"><\/noscript><img decoding=\"async\" src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7\" alt=\"collapse\" class=\"read-more-arrow up-arrow lazyload\" data-src=\"\/assets\/images\/blog\/Vector.png\"><\/a>\n                <\/div>\n            <\/div>\n        <\/div>\n        <div class=\"share-section\">\n            <span class=\"share-label\">Share Article<\/span>\n            <div class=\"social-share-buttons\">\n                <a href=\"https:\/\/www.facebook.com\/sharer\/sharer.php?u=https%3A%2F%2Fmobisoftinfotech.com%2Fresources%2Fblog%2Fprocessing-aws-alb-logs-goaccess-excel-sqlite\" target=\"_blank\" class=\"share-btn facebook-share\"><i class=\"fa fa-facebook-f\"><\/i><\/a>\n                <a href=\"https:\/\/www.linkedin.com\/sharing\/share-offsite\/?url=https%3A%2F%2Fmobisoftinfotech.com%2Fresources%2Fblog%2Fprocessing-aws-alb-logs-goaccess-excel-sqlite\" target=\"_blank\" class=\"share-btn linkedin-share\"><i class=\"fa fa-linkedin\"><\/i><\/a>\n            <\/div>\n        <\/div>\n    <\/div>\n<\/div>\n\n\n\n<script type=\"application\/ld+json\">\n[\n  {\n    \"@context\": \"https:\/\/schema.org\",\n    \"@type\": \"ImageObject\",\n    \"contentUrl\": \"https:\/\/mobisoftinfotech.com\/assets\/images\/resources\/blog\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png\",\n    \"url\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"name\": \"Guide to Processing AWS ALB Logs with GoAccess, Excel, and SQLite\",\n    \"caption\": \"Processing AWS ALB Logs using GoAccess, Excel, and SQLite \u2013 A Step-by-Step Guide\",\n    \"description\": \"A detailed guide on processing AWS ALB logs using GoAccess, Excel, and SQLite to streamline log management.\",\n    \"license\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"acquireLicensePage\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"creditText\": \"Mobisoft Infotech\",\n    \"copyrightNotice\": \"Mobisoft Infotech\",\n    \"creator\": {\n      \"@type\": \"Organization\",\n      \"name\": \"Mobisoft Infotech\"\n    },\n    \"thumbnail\": \"https:\/\/mobisoftinfotech.com\/assets\/images\/resources\/blog\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png\"\n  },\n  {\n    \"@context\": \"https:\/\/schema.org\",\n    \"@type\": \"ImageObject\",\n    \"contentUrl\": \"https:\/\/mobisoftinfotech.com\/assets\/images\/resources\/blog\/cta\/optimize-aws-infrastructure-devops-solutions-cta.png\",\n    \"url\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"name\": \"Optimize AWS Infrastructure with DevOps Solutions\",\n    \"caption\": \"Optimize Your AWS Infrastructure with Expert DevOps Solutions \u2013 Explore DevOps Services\",\n    \"description\": \"Explore how our expert DevOps solutions can optimize your AWS infrastructure and streamline your operations.\",\n    \"license\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"acquireLicensePage\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"creditText\": \"Mobisoft Infotech\",\n    \"copyrightNotice\": \"Mobisoft Infotech\",\n    \"creator\": {\n      \"@type\": \"Organization\",\n      \"name\": \"Mobisoft Infotech\"\n    },\n    \"thumbnail\": \"https:\/\/mobisoftinfotech.com\/assets\/images\/resources\/blog\/cta\/optimize-aws-infrastructure-devops-solutions-cta.png\"\n  },\n  {\n    \"@context\": \"https:\/\/schema.org\",\n    \"@type\": \"ImageObject\",\n    \"contentUrl\": \"https:\/\/mobisoftinfotech.com\/assets\/images\/resources\/blog\/cta\/enhance-cloud-performance-scalable-solutions-cta.png\",\n    \"url\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"name\": \"Enhance Cloud Performance with Scalable Cloud Solutions\",\n    \"caption\": \"Enhance Your Cloud Performance with Scalable Cloud Solutions \u2013 Discover Cloud Services\",\n    \"description\": \"Discover how our scalable cloud solutions can boost the performance and efficiency of your cloud infrastructure.\",\n    \"license\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"acquireLicensePage\": \"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\n    \"creditText\": \"Mobisoft Infotech\",\n    \"copyrightNotice\": \"Mobisoft Infotech\",\n    \"creator\": {\n      \"@type\": \"Organization\",\n      \"name\": \"Mobisoft Infotech\"\n    },\n    \"thumbnail\": \"https:\/\/mobisoftinfotech.com\/assets\/images\/resources\/blog\/cta\/enhance-cloud-performance-scalable-solutions-cta.png\"\n  }\n]\n<\/script>\n \n\n<script type=\"application\/ld+json\">\n{\n  \"@context\": \"https:\/\/schema.org\",\n  \"@type\": \"Organization\",\n  \"name\": \"Mobisoft Infotech\",\n  \"url\": \"https:\/\/mobisoftinfotech.com\/\",\n  \"logo\": \"https:\/\/mobisoftinfotech.com\/assets\/images\/MI_Logo.svg\",\n  \"sameAs\": [\n    \"https:\/\/www.facebook.com\/pages\/Mobisoft-Infotech\/131035500270720\",\n    \"https:\/\/twitter.com\/MobisoftInfo\",\n    \"https:\/\/www.instagram.com\/mobisoftinfotech\/\",\n    \"https:\/\/www.youtube.com\/channel\/UCtwuTXKUXFX7k0NSYhsMeTg\",\n    \"https:\/\/www.linkedin.com\/company\/mobisoft-infotech\",\n    \"https:\/\/in.pinterest.com\/mobisoftinfotech\/\",\n    \"https:\/\/github.com\/MobisoftInfotech\"\n  ],\n  \"contactPoint\": [\n    {\n      \"@type\": \"ContactPoint\",\n      \"telephone\": \"+1-855-572-2777\",\n      \"contactType\": \"Customer Service\",\n      \"areaServed\": \"US\",\n      \"availableLanguage\": [\"English\"]\n    },\n    {\n      \"@type\": \"ContactPoint\",\n      \"telephone\": \"+91-858-600-8627\",\n      \"contactType\": \"Customer Service\",\n      \"areaServed\": \"IN\",\n      \"availableLanguage\": [\"English\"]\n    }\n  ]\n}\n<\/script>\n","protected":false},"excerpt":{"rendered":"<p>Introduction Sometimes on projects with tight budgets we don&#8217;t have access to expensive APM tools like DataDog and New Relic. In such projects, there is no easy way to find out which of the APIs are slow causing performance issues for your application. In such cases, processing AWS Application Load Balancer logs which (if enabled) [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":31376,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_s2mail":"","footnotes":""},"categories":[286],"tags":[],"class_list":["post-31373","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Processing AWS ALB Logs with GoAccess, Excel, and SQLite | Step-by-Step Guide<\/title>\n<meta name=\"description\" content=\"Learn how to process AWS ALB logs using GoAccess, Excel, and SQLite. A comprehensive guide for analyzing, visualizing, and optimizing your logs.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Processing AWS ALB Logs with GoAccess, Excel, and SQLite | Step-by-Step Guide\" \/>\n<meta property=\"og:description\" content=\"Learn how to process AWS ALB logs using GoAccess, Excel, and SQLite. A comprehensive guide for analyzing, visualizing, and optimizing your logs.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\" \/>\n<meta property=\"og:site_name\" content=\"Mobisoft Infotech\" \/>\n<meta property=\"article:published_time\" content=\"2024-10-10T07:08:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-10-16T07:32:02+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/og-processing-aws-alb-logs-with-goaccess-excel-sqlite-banner-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"525\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Pritam Barhate\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Pritam Barhate\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#article\",\"isPartOf\":{\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\"},\"author\":{\"name\":\"Pritam Barhate\",\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/#\/schema\/person\/fa762036b3364f26abeea146c01487ee\"},\"headline\":\"Processing AWS ALB Logs with GoAccess, Excel, and SQLite\",\"datePublished\":\"2024-10-10T07:08:00+00:00\",\"dateModified\":\"2025-10-16T07:32:02+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\"},\"wordCount\":774,\"image\":{\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#primaryimage\"},\"thumbnailUrl\":\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png\",\"articleSection\":[\"Blog\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\"url\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\",\"name\":\"Processing AWS ALB Logs with GoAccess, Excel, and SQLite | Step-by-Step Guide\",\"isPartOf\":{\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#primaryimage\"},\"image\":{\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#primaryimage\"},\"thumbnailUrl\":\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png\",\"datePublished\":\"2024-10-10T07:08:00+00:00\",\"dateModified\":\"2025-10-16T07:32:02+00:00\",\"author\":{\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/#\/schema\/person\/fa762036b3364f26abeea146c01487ee\"},\"description\":\"Learn how to process AWS ALB logs using GoAccess, Excel, and SQLite. A comprehensive guide for analyzing, visualizing, and optimizing your logs.\",\"breadcrumb\":{\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#primaryimage\",\"url\":\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png\",\"contentUrl\":\"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png\",\"width\":855,\"height\":392,\"caption\":\"Processing AWS ALB Logs with GoAccess, Excel, and SQLite Banner\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/mobisoftinfotech.com\/resources\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Processing AWS ALB Logs with GoAccess, Excel, and SQLite\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/#website\",\"url\":\"https:\/\/mobisoftinfotech.com\/resources\/\",\"name\":\"Mobisoft Infotech\",\"description\":\"Discover Mobility\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/mobisoftinfotech.com\/resources\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/mobisoftinfotech.com\/resources\/#\/schema\/person\/fa762036b3364f26abeea146c01487ee\",\"name\":\"Pritam Barhate\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/0e481c7ce54b3567ac70ddfc493523eefce0bdc3ee69fd2654f8f60a79e2f178?s=96&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/0e481c7ce54b3567ac70ddfc493523eefce0bdc3ee69fd2654f8f60a79e2f178?s=96&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/0e481c7ce54b3567ac70ddfc493523eefce0bdc3ee69fd2654f8f60a79e2f178?s=96&r=g\",\"caption\":\"Pritam Barhate\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Processing AWS ALB Logs with GoAccess, Excel, and SQLite | Step-by-Step Guide","description":"Learn how to process AWS ALB logs using GoAccess, Excel, and SQLite. A comprehensive guide for analyzing, visualizing, and optimizing your logs.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite","og_locale":"en_US","og_type":"article","og_title":"Processing AWS ALB Logs with GoAccess, Excel, and SQLite | Step-by-Step Guide","og_description":"Learn how to process AWS ALB logs using GoAccess, Excel, and SQLite. A comprehensive guide for analyzing, visualizing, and optimizing your logs.","og_url":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite","og_site_name":"Mobisoft Infotech","article_published_time":"2024-10-10T07:08:00+00:00","article_modified_time":"2025-10-16T07:32:02+00:00","og_image":[{"width":1000,"height":525,"url":"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/og-processing-aws-alb-logs-with-goaccess-excel-sqlite-banner-1.png","type":"image\/png"}],"author":"Pritam Barhate","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Pritam Barhate","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#article","isPartOf":{"@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite"},"author":{"name":"Pritam Barhate","@id":"https:\/\/mobisoftinfotech.com\/resources\/#\/schema\/person\/fa762036b3364f26abeea146c01487ee"},"headline":"Processing AWS ALB Logs with GoAccess, Excel, and SQLite","datePublished":"2024-10-10T07:08:00+00:00","dateModified":"2025-10-16T07:32:02+00:00","mainEntityOfPage":{"@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite"},"wordCount":774,"image":{"@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#primaryimage"},"thumbnailUrl":"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png","articleSection":["Blog"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite","url":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite","name":"Processing AWS ALB Logs with GoAccess, Excel, and SQLite | Step-by-Step Guide","isPartOf":{"@id":"https:\/\/mobisoftinfotech.com\/resources\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#primaryimage"},"image":{"@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#primaryimage"},"thumbnailUrl":"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png","datePublished":"2024-10-10T07:08:00+00:00","dateModified":"2025-10-16T07:32:02+00:00","author":{"@id":"https:\/\/mobisoftinfotech.com\/resources\/#\/schema\/person\/fa762036b3364f26abeea146c01487ee"},"description":"Learn how to process AWS ALB logs using GoAccess, Excel, and SQLite. A comprehensive guide for analyzing, visualizing, and optimizing your logs.","breadcrumb":{"@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#primaryimage","url":"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png","contentUrl":"https:\/\/mobisoftinfotech.com\/resources\/wp-content\/uploads\/2024\/10\/processing-aws-alb-logs-with-goaccess-excel-sqlite-banner.png","width":855,"height":392,"caption":"Processing AWS ALB Logs with GoAccess, Excel, and SQLite Banner"},{"@type":"BreadcrumbList","@id":"https:\/\/mobisoftinfotech.com\/resources\/blog\/processing-aws-alb-logs-goaccess-excel-sqlite#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mobisoftinfotech.com\/resources\/"},{"@type":"ListItem","position":2,"name":"Processing AWS ALB Logs with GoAccess, Excel, and SQLite"}]},{"@type":"WebSite","@id":"https:\/\/mobisoftinfotech.com\/resources\/#website","url":"https:\/\/mobisoftinfotech.com\/resources\/","name":"Mobisoft Infotech","description":"Discover Mobility","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mobisoftinfotech.com\/resources\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/mobisoftinfotech.com\/resources\/#\/schema\/person\/fa762036b3364f26abeea146c01487ee","name":"Pritam Barhate","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/0e481c7ce54b3567ac70ddfc493523eefce0bdc3ee69fd2654f8f60a79e2f178?s=96&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/0e481c7ce54b3567ac70ddfc493523eefce0bdc3ee69fd2654f8f60a79e2f178?s=96&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0e481c7ce54b3567ac70ddfc493523eefce0bdc3ee69fd2654f8f60a79e2f178?s=96&r=g","caption":"Pritam Barhate"}}]}},"_links":{"self":[{"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/posts\/31373","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/comments?post=31373"}],"version-history":[{"count":26,"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/posts\/31373\/revisions"}],"predecessor-version":[{"id":44310,"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/posts\/31373\/revisions\/44310"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/media\/31376"}],"wp:attachment":[{"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/media?parent=31373"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/categories?post=31373"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mobisoftinfotech.com\/resources\/wp-json\/wp\/v2\/tags?post=31373"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}