Skip to main content

leetcode - pandas

 

import pandas as pd

def createDataframe(student_data: List[List[int]]) -> pd.DataFrame:
    student_df = pd.DataFrame(student_data , columns=("student_id","age"))
    return student_df;
if __name__ == '__main__':
    student_data = [
        [1, 15],
        [2, 11],
        [3, 11],
        [4, 20]
    ]
    df = createDataframe(student_data) #assign the returned dataframe to df.
    print(df)




import pandas as pd

def getDataframeSize(players: pd.DataFrame) -> List[int]:
  return list(players.shape);

  if '__name__' == __main__:
    df=pd.DataFrame
    rows , columns = getDataframeSize(df)
    print(f"This DataFrame contains {rows} rows and {columns} columns.")

Explanation:
(players.shape)
Here, players is the dataframe
In pandas, the shape The attribute of a DataFrame returns a tuple.


import pandas as pd

def selectFirstRows(employees: pd.DataFrame) -> pd.DataFrame:
    return employees.head(3);

if __name__ == '__main__':
    df=pd.DataFrame
    First_3_rows = selectFirstRows(df)
    print(employees)


answer:
import pandas as pd
def selectData(students: pd.DataFrame):
    student_101 = students.query('student_id == 101')    
    If not student_101.empty:
        return student_101[['name', 'age']]
    else:
        return df
if __name__ =='__main__':
    df= pd.DataFrame
    student=selectData(df)
    print("\nRows name AND age (using .query()):\n", student)

explanation :
To query we have to use df.query()
Rows name AND age (using .query())
This is a descriptive string that explains what the following output represents. It indicates that the output will show the "name" and "age" columns of a DataFrame, and that the data was selected using the .query() method in pandas.



import pandas as pd

def createBonusColumn(employees: pd.DataFrame):
    employees['bonus'] = employees['salary'] * 2
    return employees

if __name__ =='__main__':
    df = pd.DataFrame(data)
    call_df = createBonusColumn(df)
    print(call_df)  

explanation :
We can create the new column in the dataframe by
df[column name] = values
here
df[coloumn name ] = df[col1_values]*2


import pandas as pd

def dropDuplicateEmails(customers: pd.DataFrame):
 non_duplicated_df=customers.drop_duplicates('email')
 return non_duplicated_df

if __name__ == '__main__':
    df=pd.DataFrame
    call_df=dropDuplicateEmails(df)
    print(non_duplicated_df)

explanation :
To remove duplicates, use drop.duplicates()
non_duplicated_df=customers.drop_duplicates('email') --> removing only the duplicates in email coloumn


import pandas as pd

def dropMissingData(students: pd.DataFrame):
    new_df= students.dropna(subset = ['name'])
    return new_df
if __name__ == '__main__':
 df=  pd.DataFrame
 call_df = dropMissingData(df)
 print(new_df)  


dropna() is to drop the missing data in the dataframe
subset(['col_name ']) specifies the particular column


import pandas as pd

def modifySalaryColumn(employees: pd.DataFrame) -> pd.DataFrame:
    employees['salary'] = employees['salary'].apply(lambda salary: salary * 2)
    return employees
if __name__ == '__main__':
    df = pd.DataFrame
    call_df = modifySalaryColumn(df)
    print(call_df)

explanation:
employees['salary'] = employees['salary'].apply(lambda salary: salary * 2)
If we want to modify the column values we have to use lambda functions


import pandas as pd

def renameColumns(students: pd.DataFrame) -> pd.DataFrame:
    renamed_students = students.rename(columns={
        'id': 'student_id',
        'first': 'first_name',
        'last': 'last_name',
        'age': 'age_in_years'
    })
    return renamed_students

if __name__ == '__main__':
    df= pd.DataFrame
    call_df = renameColumns(df)
    print (call_df)

explanation : rename (columns ={values}) to change the name


answer:
import pandas as pd

def changeDatatype(students: pd.DataFrame) -> pd.DataFrame:
   students['grade'] = students['grade'].astype(int)
   return students
if __name__ == '__main__':
    df = pd.DataFrame
    call_df = changeDatatype(df)
explanation :

astype() is used for explicit conversion of the datatype

Comments

Popular posts from this blog

session 19 Git Repository

  🔁 Steps to Create a Branch in Databricks, Pull from Git, and Merge into a Collaborative Branch Create a New Branch in Databricks: Go to the Repos tab in your workspace. Navigate to the Git-linked repo. Click the Git icon (or three dots ⋮) and choose "Create Branch." Give your branch a name (e.g., feature-xyz ) and confirm. Pull the Latest Changes from Git: With your new branch selected, click the Git icon again. Select “Pull” to bring the latest updates from the remote repository into your local Databricks environment. Make Changes & Commit: Edit notebooks or files as needed in your branch. Use the "Commit & Push" option to push changes to the remote repo. Merge into the Collaborative Branch: Switch to the collaborative branch (e.g., dev or main ) in Git or from the Databricks UI. Click "Pull & Merge" . Choose the branch you want to merge into the collaborative branch. Review the c...

Session 18 monitering and logging - Azure Monitor , Log analytics , and job notification

 After developing the code, we deploy it into the production environment. To monitor and logging the jobs run in the real time systems in azure  we have scheduled the jobs under the workflow , we haven't created any monitoring or any matrics . After a few times, the job failed, but we don't know because we haven't set up any monitoring, and every time we can't navigate to workspace-> workflows, under runs to see to check whether the job has been successfully running or not and in real time there will be nearly 100 jobs or more jobs to run  In real time, the production support team will monitor the process. Under the workflow, there is an option called Job notification. After setting the job notification, we can set a notification to email . if we click the date and time its takes us to the notebook which is scheduled there we can able to see the error where it happens . order to see more details, we need to under Spark tab, where we have the option to view logs ( tha...

Transformation - section 6 - data flow

  Feature from Slide Explanation ✅ Code-free data transformations Data Flows in ADF allow you to build transformations using a drag-and-drop visual interface , with no need for writing Spark or SQL code. ✅ Executed on Data Factory-managed Databricks Spark clusters Internally, ADF uses Azure Integration Runtimes backed by Apache Spark clusters , managed by ADF, not Databricks itself . While it's similar in concept, this is not the same as your own Databricks workspace . ✅ Benefits from ADF scheduling and monitoring Data Flows are fully integrated into ADF pipelines, so you get all the orchestration, parameterization, logging, and alerting features of ADF natively. ⚠️ Important Clarification Although it says "executed on Data Factory managed Databricks Spark clusters," this does not mean you're using your own Azure Databricks workspace . Rather: ADF Data Flows run on ADF-managed Spark clusters. Azure Databricks notebooks (which you trigger via an "Exe...