AHads-oItroductiotoNaturalLaguageProcessig(NLP)Aboutthiscourse
ThiscoursewascreatedbyProf.MohammadGhassemiiFallof2020aspartoftheCSE842classatMichigaStateUiversity.Thecourseprovidesastep-by-stepguidetoNLPadmakesoassumptiosthatyouhaveabackgroudithematerial(NLPorMachieLearig).Thecotetithisrepositorywillteachyou:
Howtocollectadprocesstextdata.Howtogeeratetextusiglaguagemodels.Howtoclassifytextusigmachielearig.Howtouseadtuestate-of-the-artsequece-to-sequecemodels,icludigtrasformers.Howtoprocessspeechsigals.AlllecturesarehostedoYoutubeadcabecosumedatyourowpace(seeliksbelow).Attheedof(most)everylecturethereisatutorial+homeworkassigmetthatwilldemostratehowtoperformNLPtasksiPytho.ThePythoNotebooksareavailablethroughtheliksbelow,aditheHomeworkfolder.
ItroductioLectures:a.ItroductiototheCourseb.OverviewofSyllabusc.OverviewofCourseToolsd.OverviewoftheCourseProjectHW0:SettigupyourotebookadGitlabRepoProject:GuideliesNLPFudametalsadN-gramLaguageModelsOptioalReadigs:Chapter2adChapter3Lecture:Itroductioa.Laguageaditspropertiesb.RegularExpressiosc.TextNormalizatiod.EditDistacee.N-gramLaguageModelsf.GeeralizatioadSmoothigHW1TutorialHW1adCodeTutorial:Basicdatamaipulatios,represetatiosadstatisticsNiaveBayes,SetimetClassificatio,LogisticRegressioOptioalReadigs:Chapter4adChapter5Lecture:ItroductioOverviewa.NumericalRepresetatiosofTextb.NaiveBayesc.LogisticRegressiod.PerformaceMetricsHW2TutorialHW2adCodeTutorial:SupervisedlaguageclassificatiomodelsadtheirassessmetVectorSematics,Embeddigs,NeuralLaguageModelsOptioalReadigsChapter6adChapter7PCAWord2VecLecture:ItroductioOverviewa.SimpleCotextualRepresetatiosb.GradietDescetc.NeuralNetworksd.NeuralLagaugeModelsHW3TutorialHW3adCodeTutorial:EmbeddigsadNeuralNetworksModeligTextasaSequeceOptioalReadigsChapter8adChapter9Lecture:OverviewItroductioa.HiddeMarkovModelsb.MaximumEtropyMarkovModelsc.RecurretNeuralNetworksHW4TutorialHW4adCodeTutorial:SequeceModelsEcoder-DecoderModels,AttetioadTrasformersOptioalReadigsChapter10,Viswai,2017Lecture:OverviewItroductioa.Ecoder-DecoderNetworksb.Attetioc.TrasformersHW5TutorialHW5adCodeTutorial:TrasformersCostituecies,ParsigadDepedecyOptioalReadigsChapter12,Chapter13,Chapter14,Chapter15Lecture:OverviewItroductioa.CotextFreeGrammarb.CostituecyParsigc.StatisticalCosituecyParsigd.DepedecyParsigHW6adCodeTutorial:CotextfreegrammarSpeechProcessigOptioalReadigsChapter27Lecture:OverviewItroductioa.Phoeticsb.SpeechSigalsHW7TutorialHW7adCodeTutorial:SpeechAalysis
评论