Nenez9595 (bhgn 2)

Posted: Jul 5, 2021 | Reading time: 4 min
⚠️ Warning: This post is over a year old, the information may be out of date.
📢 I’ve moved to a new website. Please visit me at https://journal.robbi.my !

Assalamualaikum semua! Dalam cubaan pertama aku, aku try execute wget dan httrack pakai personal laptop tapi network aku tak cun disebabkan telco yang makan duit haram dengan men-FUD aku punya hotspot.

Rosak plan A aku nih, payah la camginih! Penat weh!

Tetiba aku teringat, aku ada sebijik server VPS yang aku guna untuk pacak bot-bots matrix, telegram dan IRC. So aku pun cepat-cepat SSH dan executed command dari sana.. hah! Ni la plan B aku tapi nampaknya take time jugak nak clone semua tu. Xpelah.. sambil aku tunggu hasilnya lebih baik aku buat plan C aku untuk stanby sekiranya plan B tak menjadi.

Plan C aku maksudkan disini ialah untuk scrape content dari RSS nenez9595.blogspot.com. Aku pun try cuba script scrapper RSS feed yang sedia ada written guna Ruby programming oleh Kenny Meyer tapi sayang nya ada error pulak bila aku try executed

$ ./blogspot_to_jekyll.rb https://nenez9595.blogspot.com/feeds/posts/default
Fetching feed https://nenez9595.blogspot.com/feeds/posts/default...
Traceback (most recent call last):
        1: from ./blogspot_to_jekyll.rb:119:in `<main>'
./blogspot_to_jekyll.rb:108:in `main': undefined method `fetch_and_parse' for Feedjira::Feed:Class (NoMethodError)

Tengok traceback error tu macam simple je nih. Aku pun forked, godek-godek dan patch, kod ni ada kat Gist Github tapi siot bersepah isu implicit conversion dan undefined method aku kene repair…duh. Malas aku nak layan Ruby programming nih, tak suka aku dengan tag dan simplicity dia yang jadi kompleks.

So aku end-up write aku punya scrapper RSS sendiri guna Python programming. Hah! Nih kod dia:

Fuh.. memang dah cun tapi sayangnya RSS feed blogspot ni limited la pulak. Adeh.. korang tengok la line 2-5 tu, bermacam URL pattern aku duk cuba, tapi semua limited. Puas aku ubah-ubah parameter tu semua tapi same je hasilnya, aku still tak dapat full semua posts..

Paling banyak cuma 150 post je. Nih output python script aku tadi pada terminal, which cuma dapat tarik 150 posts je dari keseluruhan posts yang wujud dalam tu

Link - https://nenez9595.blogspot.com/2017/11/good-bye-myvfriends.html
Link - https://nenez9595.blogspot.com/2017/11/pantai-timur-dan-banjir.html
Link - https://nenez9595.blogspot.com/2017/11/jom-buat-slow2.html
Link - https://nenez9595.blogspot.com/2017/11/solat-di-tengah-malam.html
Link - https://nenez9595.blogspot.com/2017/11/bayangkanlah.html
Link - https://nenez9595.blogspot.com/2017/11/hidup-pura-pura.html
Link - https://nenez9595.blogspot.com/2017/11/jealous-serba-serbi-tak-keno.html
Link - https://nenez9595.blogspot.com/2017/11/dalam.html
Link - https://nenez9595.blogspot.com/2017/11/kekuatan-strength.html
Link - https://nenez9595.blogspot.com/2017/11/why-chinese.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_20.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_19.html
Link - https://nenez9595.blogspot.com/2017/11/good-night.html
Link - https://nenez9595.blogspot.com/2017/11/wahai-insan.html
Link - https://nenez9595.blogspot.com/2017/11/pandai-ke-menunjuk-nunjuk-ke.html
Link - https://nenez9595.blogspot.com/2017/11/tv-program-agama-al-hijrah.html
Link - https://nenez9595.blogspot.com/2017/11/bala-petaka-menanti.html
Link - https://nenez9595.blogspot.com/2017/11/peta-g-khamis.html
Link - https://nenez9595.blogspot.com/2017/11/mana-nak-sama-kan.html
Link - https://nenez9595.blogspot.com/2017/11/ribut-anak-org-gaji-dan-kerja.html
Link - https://nenez9595.blogspot.com/2017/11/mana-best-guru-stau-doktor-kkm.html
Link - https://nenez9595.blogspot.com/2017/11/satu-mrkah-umno.html
Link - https://nenez9595.blogspot.com/2017/11/khawin-khawin.html
Link - https://nenez9595.blogspot.com/2017/11/petang-di-kelantan.html
Link - https://nenez9595.blogspot.com/2017/11/blunderc1.html
Link - https://nenez9595.blogspot.com/2017/11/pelik-ekkk.html
Link - https://nenez9595.blogspot.com/2017/11/my-food-before-dec-2017.html
Link - https://nenez9595.blogspot.com/2017/11/finishing-your-phd.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_49.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_9.html
Link - https://nenez9595.blogspot.com/2017/11/brrbaik-sangka.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_51.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_7.html
Link - https://nenez9595.blogspot.com/2017/11/bila-mau-menulis-betul3-ni.html
Link - https://nenez9595.blogspot.com/2017/11/first-half-finals.html
Link - https://nenez9595.blogspot.com/2017/11/mee-jusoh-jerteh.html
Link - https://nenez9595.blogspot.com/2017/11/bola-final.html
Link - https://nenez9595.blogspot.com/2017/11/kena-tegur.html
Link - https://nenez9595.blogspot.com/2017/11/makan-asam-cuka.html
Link - https://nenez9595.blogspot.com/2017/11/petang-n-hujan.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_6.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_1.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post.html
Link - https://nenez9595.blogspot.com/2017/11/khawin-or-not-khawin-yet.html
Link - https://nenez9595.blogspot.com/2017/11/puasahati-kjsmis-dsn-innin.html
Link - https://nenez9595.blogspot.com/2017/11/a-worth-while-effort.html
Link - https://nenez9595.blogspot.com/2017/11/type-of-question-in-visiting.html
Link - https://nenez9595.blogspot.com/2017/11/pay-visit.html
Link - https://nenez9595.blogspot.com/2017/11/xiarh-mebgziarshi.html
Link - https://nenez9595.blogspot.com/2017/10/sakit-memuncak.html
Link - https://nenez9595.blogspot.com/2017/10/blog-post_30.html
Link - https://nenez9595.blogspot.com/2017/10/dugaan.html
Link - https://nenez9595.blogspot.com/2017/10/aduhai-ustaz.html
Link - https://nenez9595.blogspot.com/2017/10/village-life.html
Link - https://nenez9595.blogspot.com/2017/10/avantages-ofc-budget.html
Link - https://nenez9595.blogspot.com/2017/10/berita-dunia.html
Link - https://nenez9595.blogspot.com/2017/10/terangkap.html
Link - https://nenez9595.blogspot.com/2017/10/budget-day.html
Link - https://nenez9595.blogspot.com/2017/10/visit-rounf-of-visit.html
Link - https://nenez9595.blogspot.com/2017/10/blog-post_25.html
Link - https://nenez9595.blogspot.com/2017/10/faktor-malas.html
Link - https://nenez9595.blogspot.com/2017/10/nilai-merodakkan-perdahabatan.html
Link - https://nenez9595.blogspot.com/2017/10/nilai-murni.html
Link - https://nenez9595.blogspot.com/2017/10/msjalah-mcm-mcm.html
Link - https://nenez9595.blogspot.com/2017/10/politik-sikit2-jah.html
Link - https://nenez9595.blogspot.com/2017/10/politik-masakini.html
Link - https://nenez9595.blogspot.com/2017/10/morning-bteakfast.html
Link - https://nenez9595.blogspot.com/2017/10/morning-dear.html
Link - https://nenez9595.blogspot.com/2017/10/sedop-mendengar.html
Link - https://nenez9595.blogspot.com/2017/10/nak-atau-tidak.html
Link - https://nenez9595.blogspot.com/2017/10/islam-bermusuh-dengan.html
Link - https://nenez9595.blogspot.com/2017/10/penyakit-kririkal.html
Link - https://nenez9595.blogspot.com/2017/10/benda-tu-tepat-brrlaku.html
Link - https://nenez9595.blogspot.com/2017/10/bila-marah-meluap-luap.html
Link - https://nenez9595.blogspot.com/2017/10/badan-penat.html
Link - https://nenez9595.blogspot.com/2017/10/jgn-ikut-aku.html
Link - https://nenez9595.blogspot.com/2017/10/bodoh-or-not.html
Link - https://nenez9595.blogspot.com/2017/10/tukang-tunggu.html
Link - https://nenez9595.blogspot.com/2017/10/mencari-buku-perpustakaan.html
Link - https://nenez9595.blogspot.com/2017/10/blog-post.html
Link - https://nenez9595.blogspot.com/2017/10/2nd-experience.html
Link - https://nenez9595.blogspot.com/2017/07/small-worry.html
Link - https://nenez9595.blogspot.com/2017/07/dua-benda.html
Link - https://nenez9595.blogspot.com/2017/07/sihat-kesihatan.html
Link - https://nenez9595.blogspot.com/2017/07/jaga-diri.html
Link - https://nenez9595.blogspot.com/2017/07/sejarah-membebel.html
Link - https://nenez9595.blogspot.com/2017/07/what-we-learn-from-history.html
Link - https://nenez9595.blogspot.com/2017/07/tawakal-in-english.html
Link - https://nenez9595.blogspot.com/2017/07/banyak-benda-penting.html
Link - https://nenez9595.blogspot.com/2017/07/dekat-1500-tahun-dah.html
Link - https://nenez9595.blogspot.com/2017/07/cerewet.html
Link - https://nenez9595.blogspot.com/2017/07/janji.html
Link - https://nenez9595.blogspot.com/2017/07/kuman-bergelar-boring.html
Link - https://nenez9595.blogspot.com/2017/07/bab-ikhlas.html
Link - https://nenez9595.blogspot.com/2017/07/luka-luka-luka.html
Link - https://nenez9595.blogspot.com/2017/07/adab-ziarah-orang-sakit.html
Link - https://nenez9595.blogspot.com/2017/07/hikmah-wisdom.html
Link - https://nenez9595.blogspot.com/2017/07/kita-tidur-kerana.html
Link - https://nenez9595.blogspot.com/2017/07/dugaan-hidup.html
Link - https://nenez9595.blogspot.com/2017/07/puasa-6.html
Link - https://nenez9595.blogspot.com/2017/07/sakit-pesakit-dan-penyakit.html
Link - https://nenez9595.blogspot.com/2017/07/istighfar.html
Link - https://nenez9595.blogspot.com/2017/07/diet-nak-panjang-umur.html
Link - https://nenez9595.blogspot.com/2017/07/worry.html
Link - https://nenez9595.blogspot.com/2017/07/old-friends.html
Link - https://nenez9595.blogspot.com/2017/07/belajar-bahasa-arab.html
Link - https://nenez9595.blogspot.com/2017/07/kerja-bodoh.html
Link - https://nenez9595.blogspot.com/2017/07/kawan.html
Link - https://nenez9595.blogspot.com/2017/06/beberapa-jenis-nilai.html
Link - https://nenez9595.blogspot.com/2017/06/maruah-diri-dan-bangsa.html
Link - https://nenez9595.blogspot.com/2017/06/raya-ke-lima-di-kelantan.html
Link - https://nenez9595.blogspot.com/2017/06/tak-boleh-lari-dah.html
Link - https://nenez9595.blogspot.com/2017/06/nikmat-sihat-musim-raya.html
Link - https://nenez9595.blogspot.com/2017/06/raya-pertama.html
Link - https://nenez9595.blogspot.com/2017/06/maaf.html
Link - https://nenez9595.blogspot.com/2017/06/kejar-mengejar.html
Link - https://nenez9595.blogspot.com/2017/06/trouble.html
Link - https://nenez9595.blogspot.com/2017/06/bacalah-al-quraan.html
Link - https://nenez9595.blogspot.com/2017/06/rezeki-rezki-rezji.html
Link - https://nenez9595.blogspot.com/2017/06/after-this-what.html
Link - https://nenez9595.blogspot.com/2017/06/sejenak-di-sana-sebagai-pesakit.html
Link - https://nenez9595.blogspot.com/2017/06/fruits-of-labour-pulangan-hasil.html
Link - https://nenez9595.blogspot.com/2017/06/pitih-duit.html
Link - https://nenez9595.blogspot.com/2017/06/doa-aku.html
Link - https://nenez9595.blogspot.com/2017/06/buat-baik.html
Link - https://nenez9595.blogspot.com/2017/06/rehat-relax.html
Link - https://nenez9595.blogspot.com/2017/06/the-best.html
Link - https://nenez9595.blogspot.com/2017/06/nasihat.html
Link - https://nenez9595.blogspot.com/2017/06/feeling-good.html
Link - https://nenez9595.blogspot.com/2017/06/postman.html
Link - https://nenez9595.blogspot.com/2017/06/keadaan-boring-jemu-menjemukan.html
Link - https://nenez9595.blogspot.com/2017/06/berbuka-puasa.html
Link - https://nenez9595.blogspot.com/2017/06/berbagai-bagai-jenis-orang.html
Link - https://nenez9595.blogspot.com/2017/06/si-bonda-antara-dua-zaman.html
Link - https://nenez9595.blogspot.com/2017/06/nasibku-baik-syukurlah.html
Link - https://nenez9595.blogspot.com/2017/06/write-well.html
Link - https://nenez9595.blogspot.com/2017/06/penat-letih.html
Link - https://nenez9595.blogspot.com/2017/06/malam-lai-latul-qadar.html
Link - https://nenez9595.blogspot.com/2017/06/mengapa-terjadi-begini.html
Link - https://nenez9595.blogspot.com/2017/06/eating-well.html
Link - https://nenez9595.blogspot.com/2017/06/reading-al-quraan.html
Link - https://nenez9595.blogspot.com/2017/06/di-mana-kita-buang-masa.html
Link - https://nenez9595.blogspot.com/2017/06/panduan-khatam-al-quraan-bulan-ramadhan.html
Link - https://nenez9595.blogspot.com/2017/06/social-visit-lawatan-sosial.html
Link - https://nenez9595.blogspot.com/2017/06/feeling-perasaan.html
Link - https://nenez9595.blogspot.com/2017/05/sayang.html
Link - https://nenez9595.blogspot.com/2017/05/future.html
Link - https://nenez9595.blogspot.com/2017/05/taking-risk.html
Link - https://nenez9595.blogspot.com/2017/05/tiga-jenis-ubat.html
Link - https://nenez9595.blogspot.com/2017/05/maaf-tegur-sikit-ni.html

Hadeh.. sekali lagi plan aku sangkut dalam percubaan. Aku harap nak plan C ni nak backup, sekali tak boleh pakai plak. Maybe kene buat plan D pulak nih tapi takpe-takpe, kita tunggu hasil dari plan B dlu. Mana tahu ada luck?

Bersambung pada bahagian ke-3 pula. Wassalam ~

update

Update 22/07/2121:

Oh nice, add mamat bhai ni forked kod Ruby aku dan fixed kan error tu tu semua.
korang boleh check kat forked Github gist ni kalau nak cuba.
Padu la korang guna Ruby programming ni ekk..apa benda la korang makan yer

Edit

Have some thoughts, discussion or feedback on this post?

💬 Send me an email