3

Linux basic install – Migrated to a new server 1 of 4

Migrated to a new server! For the past 20 years I been running various linux server to host my websites and mail. It evolved over time and the very last server was installed about 5 years ago. I decided that a new server was in order and decided to redesign some things and now here we are. Just some personal notes on how the new server is configured and setup. You can follow my steps or make changes but if you do anything thats better or noteworthy please let me know! This will be a multi-part article so that I… Continue Reading

1

ECE(Elasticsearch Cloud Enterprise) snapshots with minio – TLS!

PLEASE use THIS POST instead, as many items were updated and changed. Configuring snapshots for ECE(Elasticsearch Cloud Enterprise) or deployments for ECE from a S3 object storage or on a s3 compliant storage with publicly trusted certificates are easy but how do you configure the snapshot repository if you are using self-signed or internally signed certificates ? There are 2 ways of configuring snapshot repository and snapshots on ECE. First you can configure the snapshot repository on ECE. Once you configure the snapshot repository in the Admin UI, you can configure found-snapshots for each deployment via the Admin UI. Unfortunately,… Continue Reading

0

Enterprisesearch with elasticsearch in docker container

Enterprisesearch in docker container Previously, on this post I’ve created a script to deploy the elastic stack using docker containers. Enterprise search was released as of 7.7.0 and it provides both AppSearch and WorkplaceSearch into a single solution. deploy-elastic.sh script I’ve added the entsearch mode so that you can deploy the Enterprisesearch and use it for AppSearch and WorkplaceSearch. Simple run ./deploy-elastic.sh entsearch 7.15.1 The script will check to see if your stack is 7.15+ or else it will exit. Enterprisesearch will be stood up using a container named entsearch Enterprisesearch will listen on port 3002 (standard port) Enterprisesearch is… Continue Reading

12

Fleet server with elasticsearch in docker container

UPDATE – 3/30/2022: another 8.1.x update to automatically populate the CA trusted fingerprint and the Advanced YAML settings to add the generated ca.crt onto fleet for easier use – Please go to the bottom of the article for an explaination UPDATE: 8.1.0 release introduced some changes where the default policies are no longer created on default and you will need to manually create it. I will add the steps to the end of the document Fleet server in docker container Fleet & Fleet server was released as of 7.14.0 and it uses the elastic-agent as a single, unified way to… Continue Reading

2

Elastic Cloud on kubernetes (ECK) on minikube

ECK is Elastic cloud on kubernetes – Kubernetes Operator pattern that extends basic kubernetes orchestration to easily deploy, secure, upgrade Elasticsearch and the rest of the stack such as kibana, logstash, various beats, and much more. In my previous article I wrote about my kube.sh script which is a wrapper that installs a minikube environment to run your kubernetes projects. We will use the wrapper to deploy our kubernetes environment and start deploying elasticsearch using ECK. The steps below are not limited to my minikube wrapper script but you can follow the same process for any kubernetes environment. Lets get… Continue Reading

0

Fast portable wiki that syncs to your private github repo

I been needing alot of things lately. I was using evernote to keep my notes and ever since they changed their free offering, I’ve had my notes scattered all over notepad++, atom, code, etc and needed a quick and fast place to stop and keep up with my notes. I needed something portable and that will not get deleted, so I came up with my wiki.sh script! Features tested on macOS, linux, wsl creates wiki directory in your ${HOME} cleanup clearns off everything runs in both http and https ports are configurable do not need root, just need to be… Continue Reading

0

quick, fast & dirty minio server using docker

I need a quick & fast method of standing up a not so fancy minio server to test some s3 functionality. Nothing fancy was needed nor the need for multiple nodes or large datastores, but I did need it something that is easily installed/cleanedup and repeated. minio.sh was born! Features tested on macOS, linux, wsl creates myminio directory in your ${HOME} cleanup cleans off everything do not need root just need to be part of the docker group Requirements docker is needed. any kind of s3 client like mc, s3cmd is good to have Installation $ curl -fsSL https://raw.githubusercontent.com/jlim0930/scripts/master/minio.sh -o… Continue Reading

6

Quickly deploy elasticsearch with docker

UPDATE: there is a new version that was released in March 2022 and you can read about it here I needed a way to quickly stand up various versions of elasticsearch for testing. Sometimes just 1 instance was needed and at other time a small cluster and configure it with TLS and security settings. I spent way too much time installing and reinstalling the software on my vm and knew that this will not work well for me. So I set out to look for a light weight, portable, fast, re-produce-able solution that I can quickly stand up and delete… Continue Reading

1

kafka – stand up a test instance with SSL for testing

I had a need to stand up a Kafka instance with SSL to test SSL handshakes. Today was the first time looking at Kafka so needless to say I was a bit lost. 🙁 Started out looking up various projects and found some interesting things that enabled me to setup a instance of kafka using docker containers with SSL. Requirements: git, docker, docker-compose installed on your server. Clone wurstmeister/kafka repo Get confluent’s kafka-generate-ssl.sh script, run it and follow all the instructions. Please make sure to remember the passphrase and the truststore/keystore passwords. This will generate the following Create “certs” directory… Continue Reading