Category : devops

Requirement: We have common DevOps config files which are applicable for all repositories under common organisation in GitHub. Lets say i have 4 repositories A, B, C, D. All 4 repositories has same config file – .github/devops/config.py If i modify/update .github/devops/config.py in repository A, It should automatically update/overwrite in all 3 remaining repositories. This is ..

Read more

I am running a series of models, implemented as SparkML transformers, whose execution I like to monitor. Specifically, I like to monitor which version of the model is used in specific task executions. I imagine recording the version of the transformer class during run-time execution for monitoring and possibly fetching a more up-to-date version – ..

Read more

Hi I’m trying to build a pipeline using python in Azure. The problem is when I build the pipeline I’m getting the error "Install Python dependencies." The official documentation talks about building a requirements.txt that uses pip to install the dependencies. https://docs.microsoft.com/en-us/azure/devops/pipelines/ecosystems/python?view=azure-devops The problem is I don’t know how to make it so that the ..

Read more

I am having a python code running inside the Kubernetes POD, To trigger that I have another python script that runs in the background with "nohup".This nohup python script reads input data from pubsub and passes that to python application to process. As of now I am executing this script manually whenever I deploy the ..

Read more

I have about 20 project written in Python and deployed on the same server. Most of these project are APIs running inside Docker containers, but there’re also several periodic scripts which are being triggered using cron without Docker. All the projects write their logs to a dedicated file (for Docker containers there’re also container logs, ..

Read more