Apache spark pyspark jobs
As an experienced Java Developer, I need your expertise in integrating Apache Camel with our web app. This integration is primarily aimed at facilitating the routing of messages between our system and external APIs. Key Requirements: - Understanding of Apache Camel: You should have comprehensive experience working with Apache Camel, ideally in a similar integration scenario. - Communication with External APIs: Our system needs to seamlessly communicate with multiple external APIs. You should have a solid understanding of RESTful APIs and experience integrating them. - Synchronous & Asynchronous Communication: The integration needs to support both synchronous and asynchronous communication with the external APIs. Feel free to provide examples of similar project...
I am in need of a Full-Stack developer well-versed in Apache Kafka for configuration, message serialization, deserialization, event streaming, and processing. Additionally, you will be responsible for developing Spring Boot microservices that encompass user authentication, authorization, database integration, data modeling, and REST API development. Key responsibilities include: - Kafka setup and configuration - Kafka message serialization and deserialization - Kafka event streaming and processing - Designing and implementing user authentication and authorization within Spring Boot - Integrating databases and modeling data effectively - Developing REST APIs with Spring Boot The ideal candidate for this project should have extensive experience with Kafka and Spring Boot as well as...
I am looking for an experienced developer or team who can create a socia...displayed next to their names. - News Feed: This will be a key component of the app, where users can see updates and posts from other fans. - Direct Messaging: Instant communication between users will keep the community alive, whether users want to plan events or simply chat. You should be proficient in developing secure messaging systems. - Blog: Allowing fans to blog about their idols can help to spark active discussions and attract new users. Ideal candidates should have proven experience in creating similar apps, and be up-to-date with the features that create an engaging and safe space in social media. A sense of enthusiasm and understanding for the community of 'fan or idol chasers' is desire...
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
As a project owner, I'm in need of a proficient backend developer chiefly for the deployment of a Python Django project. This includes: - Setting up server and database - Deploying the project using both Nginx reverse proxy and Apache - Enhancing backend performance The best candidate should offer rich experience in Python Django project deployment as well as server setup and optimization. There won't be any need for coordination with other teams or members. Hence, the ability to work independently is crucial. Please remember to include your relevant experience in your application.
...and PySpark to AWS Sagemaker. Your task will be to: - Understand two models I have running locally. One is a Rstudio logistic regression model, and the other is a pySpark XGboost also running on local. - Migrate These two models to AWS SAGEMAKER. Data will be on S3 -Prepare models to run on sagemaker totally, so that we can do training and testing 100% on sagemaker.-Models are already running on a local computer, but I need to move them to Sagemaker 100%. Data is on S3 already. -You need to configure and prepare Sagemaker from end to end, and teach me how you did it, since I need to replicate it in another system. -I will give you the data and access to AWS Ideal Skills and Experience: - Demonstrated experience in performing similar migrations - Proficiency in Python, ...
I need a freelancer to create two engaging brand pages that will showcase my physical goods to a targeted audience of young adults, for Amazon and Flipkart. The brand pages should spark interest and increase engagement, effectively spotlighting my products and promoting their unique features in a stylistically intriguing way that is appealing to youthful demographics. Ideal Skills & Experience: - Experience in creating compelling designs and layouts for brand pages - Strong knowledge of the current trends and preferences of young adults - Ability to highlight the features of physical goods in creative ways - Great understanding of visual elements that resonate with young audiences. Remember, our main goal here is to visually showcase our products to young adults. Create a spec...
I am in need of an experienced Linux server expert who can assist me in setting up a robust and functional Linux server. Your responsibilities would include: - Installation of the server, ensuring it's in proper working condition. - Configuration of both LiteSpeed and Apache web server softwares. Experience in these is essential. - Facilitating user management across the server. - Installing Plesk control panel on the server. Familiarity with this control panel will be a major advantage. Please reach out if you have a proven track record in Linux server management, installation, and configuration.
I'm struggling with a problem - I've installed SSL on my server and it seems to be running smoothly with Apache. However, the issue arises with my DNS, where the SSL isn't working. Precisely, HTTPS isn't functioning as expected. What I need is someone experienced with server setup, particularly SSL encryption, Apache, DNS configurations, and fault-finding to step in and sort this out. IDEAL CANDIDATE: • Proven experience with SSL and DNS. • Knowledge of server configurations. • Proficient in troubleshooting and resolving technical issues. • Attention to detail for fault-finding. Please include your previous experience dealing with similar issues, your approach to problem-solving and why you're the best fit for this job in you...
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
I am in urgent need of Hadoop/Spark developer who is proficient in both Scala and Python for a data processing task. I have a huge volume of unstructured data that needs to be processed and analyzed swiftly and accurately. Key Project Responsibilities: - Scrubbing and cleaning the unstructured data to detect and correct errors. - Designing algorithms using Scala and Python to process data in Hadoop/Spark. - Ensuring effective data processing and overall system performance. The perfect fit for this role is a professional who has: - Expertise in Hadoop and Spark frameworks. - Proven experience in processing unstructured data. - Proficient coding skills in both Scala and Python. - Deep understanding of data structures and algorithms. - Familiarity with data ...
Need a apache kafka tutor for self learning
...Summarisation: Use AI to get summaries of relevant sections identified through keyword analysis after connecting it to an API. 4. Newsletter Generation: Put together a newsletter that includes: Summaries of the data points with references to the original PDF files along with the original table and URL links of the PDF scraped II. Requirements • Experience with PDF processing libraries like PyPDF2 or Apache PDFBox. • Familiar with handling XBRL data. • Ability to integrate with an AI summarisation service (e.g., Google Cloud Natural Language API). • Experience with newsletter creation tools (e.g., Mailchimp, Campaign Monitor). • Familiarity with process flow diagrams. III. Additional Information • I have a process flow diagram outlining the desired...
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
...Key Features: - Rule Enforcement: The app should ensure that the game is played according to the set rules. - Turn Management: The application is responsible for managing the flow of turns in the game. - Dice Rolls: The app should include a random dice roll feature. Ideal Skills: - Proficiency in Java - Experience with NetBeans - Understanding of game terms like 2D6 and D66 - Experience using Apache Derby Database jdbc network connectivity (e.g. jdbc:derby://localhost:1527/dbname) Deliverable: A well designed, complete NetBeans Java Swing Application project folder that I can open in NetBeans and execute out of the box AND continue to develop the application. Environment: Windows 10 Derby (
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
...sources. Here are the main tasks I need assistance with: - Optimize my website's search functionality to quickly and effectively retrieve the required data. - Integrate LucidWorks Fusion with the data from my website databases and product inventory system to support an enterprise level search and data analytics. - it’s a complex enterprise search involving 10 million + skus - good experience with spark and solr is must along with complex fusion pipelines Ideal skills and experience for this job include: - Proven experience in LucidWorks Fusion. - Strong understanding of website databases and product inventory systems to facilitate seamless integration. - Expertise in website search optimisation techniques and enterprise-level data integration. - Willing to wor...
I am in need of expert assistance to help set up my Apache Tomcat 7.061 server on a Windows 2019 machine, compile a War file and get it up and running. The War file serves as a dashboard to an app previously functional before migration to a new server. Encountered issues include server configuration and deployment errors. The ultimate goal is to have the file accessible here: Ideal candidate should have: • Proficiency in Windows server management • Extensive experience with Apache Tomcat server setup • Proficiency in War file compilation • Ability to debug and fix server configuration and deployment errors Knowledge of the app/dashboard's functionality or code changes made post-migration may not be necessary, as specific details were not provided...
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
I am looking for a skilled mobile app developer who can create a native app for both Android and iOS platforms. The project requires the following: Features: - Data base: PostgreSQL or MySQL or MongoDB - Make PDF from data base: Apache PDFBox or iText - Email service: SendGrid or Mailgun - STORAGE of PDF: Apple (iOS): Secure Enclave API and Google (Android): Keystore System - PAYMENT : stripe - ESIGNATURE : service's API to initiate sending a one-time password (OTP) via SMS. DocuSign or Adobe Sign or SignNow Design : Design already done on Figma English version : (Copy)?type=design&node-id=0%3A1&mode=design&t=fWuFnb5PnhqXNVYT-1 French version :
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
...and MP4 files. Sample code is attached. Each can be opened in a Fancybox Modal window. Sometimes the PDF/MP4 files are overwritten with a newer version with the same exact name. Of course browsers often use the cached version instead. The files are big enough where I want the browser to cache them, but only until they change - then the browser needs to grab the new version from the server. The apache and .htaccess expire headers haven't done what I need. I read that some codebases exist that will assign a variable to the end of the URL based on a file hash. I thought this may be the way to go. The solution needs to be editable by me. I am more of a general IT person who can do some front end development and tweak some code. So markup and explanations are important or...
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
I am seeking a knowledgeable freelancer capable of assisting with a specific task on my WooCommerce store. I need help migrating customer, affiliate, order, and product data from one store (Store A on apache) into a new one (Store B on nginx). Some technical components to be aware of include: - The new store runs on NGINX. - There seems to be difficulty with data deletion on Store B -- data remains somewhere in the database even when it appears deleted. In your role, you'd specifically be assisting with: - Accurate migration of specific data types - namely customer, affiliate, order, and product details from Store A to Store B. - Identifying and rectifying issues leading to a mismatch in referral ID numbers on Store B after data import. - Rectifying difficulties with data de...
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
I am looking for an experienced book cover designer who can create a striking, professional cover for my novel. Key aspects: - The centerpiece of the design should be a photograph of the neck of a cello/violin. The cello must spark curiosity yet also convey the significance it holds in the story ( main plot is a pianist composes a concerto for cello and piano for two lovers killed in the Holocaust) - The color background should be black, . Fonts should be in white against black and the subtitle in an orange or ocher color - The front and back covers need to be designed in a cohesive style. Only text will be on back Ideal Candidate: - Someone with a strong portfolio of book cover designs, preferably for fiction novels. - I already have purchased the image I want for the front - S...
I need a computer simulation of an electromagnet that is created using spark gaps for research purposes. This simulation is expected to find out the power needed to generate a magnetic field in a distance of 1000 meters. Ideal Skills and Experience: - Expertise in electromagnetism and magnetic field simulation. - A general understanding of how a spark gap works. - Proficiency in suitable computer software to create such simulations, such as, CST. - A good understanding of physics, particularly in the area of electromagnetic fields - Previous experience in similar research or simulations would be an advantage Key Requirements: - The simulation should showcase the magnetic field generated by the electromagnet. - Focus on the distance of 1000 meters is crucial, and the outpu...
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
...that? We develop camera safety solutions utilizing AI to monitor and detect objects and risky events. We prevent collisions and accidents, ensure workers' safety, and provide assistance to HSE managers. Our systems are helping all over Europe, and in the future, we plan to expand to other continents, too. What are we working on right now? Currently, we are developing a brand new safety system SPARK from scratch. It's an exciting and innovative project with plenty of challenges. That's why we are looking for a software enthusiast to join our development team, who will take care of developing the front-end of our web app and assist with simple backend modifications. You are the right fit for us if you: - have advanced knowledge of React and Node.js - feel com...
I'm in need of a highly skilled developer to assist me with a large scale integration design project. My aim is to achieve a range of functionalities including data transformation, API integration, and workflow automation Key requirements: - Proficiency in XML, YAML, and Java - Experience with Apache Karavan - Strong understanding of visual integration design - Ability to work on a large scale project with multiple components Your responsibilities: - Collaborate with me in the design and implementation of the integration. - Ensure that the design is scalable and efficient. - Implement data transformation, API integration, and workflow automation features. This project is on a large scale and requires a developer who is comfortable working with multiple components. If you hav...
This project requires expertise in Event-B Modelling & Spark I think you must be an Electronic, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
Looking for an experienced professional who can write efficient Apache mod_rewrite code for my site. Desired Skills: - Knowledge of Apache code for mod_rewrite. - Detail-oriented individual who can identify and resolve any potential issues efficiently. Details: I am creating a Joomla website. The site uses an add-on module to display articles. When I click an article (see the following page: ), the resulting URL is something like the following the following: :ehime-kihoku&catid=14 If possible, I would like it to be "" Can this be done with apache code for the mod_rewrite? If so, what is the estimated cost. I look forward to discussing the specifics once we
I am looking for an expert who can help with the configuration of a Virtual Private Se...the configuration of a Virtual Private Server (VPS) for a React project. An ideal candidate would have in-depth experience in Ubuntu and Apache server set-up. Key tasks will include: - Setting up an Ubuntu operating system in a VPS environment. - Correct configuration of an Apache server for optimal performance of a React project. - Implementing basic security procedures, specifically the use of SSH Keys. Firewall setup and advanced intrusion prevention systems won't be necessary for this project. However, the chosen freelancer should ensure that the server is secure and resistant to common cyber threats. Strong skills in server management, Ubuntu, Apache, and cybersecurity...
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependencies, and functionality. Working closely with data engineers to develop a migration strategy for converting pipelines from the current framework to the target framework. Designing, building, and testing new data pipelines in the target framework, ensuring they meet or exceed existing performance and reliability standards. Debugging and troubleshooting issues that arise during the migration process, working collaboratively with cross-functional teams to resol...
Hi, Please apply only individual. Agency can apply but budget should not be more than mentioned. Role : GCP Engineer (OTP) Exp : 7 + yrs SHIFT: IST Cloud Storage Buckets, BigQuery (SQL, Data Transformations and movement) Airflow (python, DAGs), DBT IAM Policies PyCharm Databricks (pySpark), Azure DevOps Clear and confident communication
...and PySpark to AWS Sagemaker. Your task will be to: - Understand two models I have running locally. One is a Rstudio logistic regression model, and the other is a pySpark XGboost also running on local. - Migrate These two models to AWS SAGEMAKER. Data will be on S3 -Prepare models to run on sagemaker totally, so that we can do training and testing 100% on sagemaker.-Models are already running on a local computer, but I need to move them to Sagemaker 100%. Data is on S3 already. -You need to configure and prepare Sagemaker from end to end, and teach me how you did it, since I need to replicate it in another system. -I will give you the data and access to AWS Ideal Skills and Experience: - Demonstrated experience in performing similar migrations - Proficiency in Python, ...
After updating Dolibarr v11 to v17, database does not update properly. No error was found when it was done, Every step says "ok" It is an example for any categories. Error sample Dolibarr: 17.0.4 - Nivel de funciones: 0 PHP: 7.4.3-4ubuntu2.20 Server: Apache/2.4.41 (Ubuntu) OS: Linux ubuntuserver-i-hellbam 5.4.0-174-generic #193-Ubuntu SMP Thu Mar 7 14:29:28 UTC 2024 x86_64 Agente de usuario: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:124.0) Gecko/20100101 Firefox/124.0 URL solicitada: /product/ Referer: Administrador de menús: Módulos/Aplicaciones: syslog, user, export, propal, contrat, expedition
My project involves the precise and strategic usage of OpenAI API for a particular functionality - natural language processing (NLP). Hence, I am looking for an expert in Jmeter to execute performance testing. Key Tasks: - Performance testing for web-based application - Focusing primarily on its ability to efficiently convert voice to text Required Skills: - Proficiency in using Jmeter for performance testing - Solid understanding of OpenAI API - Experience in Natural Language Processing (NLP) testing - Expertise in testing Voice to Text systems Please include in your proposal your approach to this task, previous experiences, and how you can use these to contribute to the success of this project. If you have any questions, feel free to ask. My approach (tentative) 1. local PC setup us...
I need help to compile my War file and run it on my Apache Tomcat 7.061 Server. Tomcat server needs setup. War file is dashboard to an app. It used to run fine before I migrated to a new server. The machine is Windows 2019. I have the old Tomcat. Backup.
I'm looking for a savvy marketer who shares my vision of developing an effective LinkedIn marketing campaign for both B2B and B2C audiences. My main intentions are to elevate brand recognition and generate leads. Ideal Skills: • Proficient in LinkedIn Analytics to measure and opti...audience. • Conceptualizing and executing a digital strategy targeting B2B and B2C markets. • Engaging in lead generation activities to support our business objectives. • Monitoring campaign performance, analyzing key metrics, and optimizing based on these insights. • Amplifying brand perception, credibility, and reach on LinkedIn. You're a top candidate if you are based in India have the ability to spark interest and interaction through innovative content and spru...
The Data Engineer contractor role will be a project based role focused on migrating data pipelines from legacy infrastructure and frameworks such as Scalding to more modern infrastructure we support such as Spark Scala. This role will be responsible for: Analyzing existing data pipelines to understand their architecture, dependencies, and functionality. Working closely with data engineers to develop a migration strategy for converting pipelines from the current framework to the target framework. Designing, building, and testing new data pipelines in the target framework, ensuring they meet or exceed existing performance and reliability standards. Debugging and troubleshooting issues that arise during the migration process, working collaboratively with cross-functional teams to resol...
We are looking for an engineer experienced with Atlas Search / the underlying Apache Lucene. Being comfortable working with Typescript and Atlas Search / MongoDB is a must. *The task:* We provide a storefront containing 100k+ products from different companies. These products have many properties: name, description, brand, color, size, etc. All of which ponder differently in our search results. Our current issue is that for some queries, our atlas search implementation is suboptimal: we suspect our set of rules could be built better, and we should also be able to leverage a different tokenizer that would work better for our use-cases. We are looking for an experienced consultant to refactor our algorithm to fix some longstanding issues. *What you will be given:* A document cont...
I am in need of a seasoned software engineer with intermediate expertise in Python. Your primary responsibility will be data processing using not only Python, but also complemented by Spark, Databricks, and Airflow. Therefore, prior experience with these is also expected. Ideal skills for this role include: - Intermediate to advanced skill level in Python - Experience with Spark, Databricks, and Airflow - Proficient in data processing tasks Your expertise in these areas will be integral to the success of this project and your problem-solving skills will be highly valued. I look forward to your proactive participation in this exciting project.
This project requires expertise in Event-B Modelling & Spark I think you must be an Architecture, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
This project requires expertise in Event-B Modelling & Spark I think you must be an Architecture, elevator engineer or electrical engineer and a programmer to be able to do this If you feel you are confident with this requirement and you can do this kindly place your bid while we discuss extensively on the requirement and timeline
I am seeking an experienced professional who is proficient in both Event-B modelling and Spark. If you've worked on similar projects, it would be beneficial. A detailed project proposal showing your approach will be valuable. Apply if you think you can make a significant contribution to this project.
I'm looking for an experienced 2D animator to create an educational animation. The animation will primarily target adults (19+ years) so it needs to be engaging yet informative. Ideal skills and experience: - Expertise in 2D animation - Between 3-5 minutes...passion for social justice and a commitment to using animation as a tool for advocacy and change. How to Apply: If you're ready to make a difference through the power of animation, we want to hear from you! Please submit your portfolio showcasing your animation work along with your resume and a brief cover letter explaining why you're the perfect fit for this project. Join us in igniting a spark of hope and inspiring change through the art of animation. Together, let's create a future where justi...
