📢 Actions Speak Louder Than Words!

Nenez9595 (bhgn 2)

Posted: Jul 5, 2021 | Reading time: 4 min

Assalamualaikum semua! Dalam cubaan pertama aku , aku try execute wget dan httrack pakai personal laptop tapi network aku tak cun disebabkan telco yang makan duit haram dengan men-FUD aku punya hotspot.

Rosak plan A aku nih, payah la camginih! Penat weh!

Tetiba aku teringat, aku ada sebijik server VPS yang aku guna untuk pacak bot-bots matrix, telegram dan IRC. So aku pun cepat-cepat SSH dan executed command dari sana.. hah! Ni la plan B aku tapi nampaknya take time jugak nak clone semua tu. Xpelah.. sambil aku tunggu hasilnya lebih baik aku buat plan C aku untuk stanby sekiranya plan B tak menjadi.

Plan C aku maksudkan disini ialah untuk scrape content dari RSS nenez9595.blogspot.com . Aku pun try cuba script scrapper RSS feed yang sedia ada written guna Ruby programming oleh Kenny Meyer tapi sayang nya ada error pulak bila aku try executed

$ ./blogspot_to_jekyll.rb https://nenez9595.blogspot.com/feeds/posts/default
Fetching feed https://nenez9595.blogspot.com/feeds/posts/default...
Traceback (most recent call last):
        1: from ./blogspot_to_jekyll.rb:119:in `<main>'
./blogspot_to_jekyll.rb:108:in `main': undefined method `fetch_and_parse' for Feedjira::Feed:Class (NoMethodError)

Tengok traceback error tu macam simple je nih. Aku pun forked, godek-godek dan patch, kod ni ada kat Gist Github tapi siot bersepah isu implicit conversion dan undefined method aku kene repair…duh. Malas aku nak layan Ruby programming nih, tak suka aku dengan tag dan simplicity dia yang jadi kompleks.

So aku end-up write aku punya scrapper RSS sendiri guna Python programming. Hah! Nih kod dia:

Fuh.. memang dah cun tapi sayangnya RSS feed blogspot ni limited la pulak. Adeh.. korang tengok la line 2-5 tu, bermacam URL pattern aku duk cuba, tapi semua limited. Puas aku ubah-ubah parameter tu semua tapi same je hasilnya, aku still tak dapat full semua posts..

Paling banyak cuma 150 post je. Nih output python script aku tadi pada terminal, which cuma dapat tarik 150 posts je dari keseluruhan posts yang wujud dalam tu

Link - https://nenez9595.blogspot.com/2017/11/good-bye-myvfriends.html
Link - https://nenez9595.blogspot.com/2017/11/pantai-timur-dan-banjir.html
Link - https://nenez9595.blogspot.com/2017/11/jom-buat-slow2.html
Link - https://nenez9595.blogspot.com/2017/11/solat-di-tengah-malam.html
Link - https://nenez9595.blogspot.com/2017/11/bayangkanlah.html
Link - https://nenez9595.blogspot.com/2017/11/hidup-pura-pura.html
Link - https://nenez9595.blogspot.com/2017/11/jealous-serba-serbi-tak-keno.html
Link - https://nenez9595.blogspot.com/2017/11/dalam.html
Link - https://nenez9595.blogspot.com/2017/11/kekuatan-strength.html
Link - https://nenez9595.blogspot.com/2017/11/why-chinese.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_20.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_19.html
Link - https://nenez9595.blogspot.com/2017/11/good-night.html
Link - https://nenez9595.blogspot.com/2017/11/wahai-insan.html
Link - https://nenez9595.blogspot.com/2017/11/pandai-ke-menunjuk-nunjuk-ke.html
Link - https://nenez9595.blogspot.com/2017/11/tv-program-agama-al-hijrah.html
Link - https://nenez9595.blogspot.com/2017/11/bala-petaka-menanti.html
Link - https://nenez9595.blogspot.com/2017/11/peta-g-khamis.html
Link - https://nenez9595.blogspot.com/2017/11/mana-nak-sama-kan.html
Link - https://nenez9595.blogspot.com/2017/11/ribut-anak-org-gaji-dan-kerja.html
Link - https://nenez9595.blogspot.com/2017/11/mana-best-guru-stau-doktor-kkm.html
Link - https://nenez9595.blogspot.com/2017/11/satu-mrkah-umno.html
Link - https://nenez9595.blogspot.com/2017/11/khawin-khawin.html
Link - https://nenez9595.blogspot.com/2017/11/petang-di-kelantan.html
Link - https://nenez9595.blogspot.com/2017/11/blunderc1.html
Link - https://nenez9595.blogspot.com/2017/11/pelik-ekkk.html
Link - https://nenez9595.blogspot.com/2017/11/my-food-before-dec-2017.html
Link - https://nenez9595.blogspot.com/2017/11/finishing-your-phd.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_49.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_9.html
Link - https://nenez9595.blogspot.com/2017/11/brrbaik-sangka.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_51.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_7.html
Link - https://nenez9595.blogspot.com/2017/11/bila-mau-menulis-betul3-ni.html
Link - https://nenez9595.blogspot.com/2017/11/first-half-finals.html
Link - https://nenez9595.blogspot.com/2017/11/mee-jusoh-jerteh.html
Link - https://nenez9595.blogspot.com/2017/11/bola-final.html
Link - https://nenez9595.blogspot.com/2017/11/kena-tegur.html
Link - https://nenez9595.blogspot.com/2017/11/makan-asam-cuka.html
Link - https://nenez9595.blogspot.com/2017/11/petang-n-hujan.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_6.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post_1.html
Link - https://nenez9595.blogspot.com/2017/11/blog-post.html
Link - https://nenez9595.blogspot.com/2017/11/khawin-or-not-khawin-yet.html
Link - https://nenez9595.blogspot.com/2017/11/puasahati-kjsmis-dsn-innin.html
Link - https://nenez9595.blogspot.com/2017/11/a-worth-while-effort.html
Link - https://nenez9595.blogspot.com/2017/11/type-of-question-in-visiting.html
Link - https://nenez9595.blogspot.com/2017/11/pay-visit.html
Link - https://nenez9595.blogspot.com/2017/11/xiarh-mebgziarshi.html
Link - https://nenez9595.blogspot.com/2017/10/sakit-memuncak.html
Link - https://nenez9595.blogspot.com/2017/10/blog-post_30.html
Link - https://nenez9595.blogspot.com/2017/10/dugaan.html
Link - https://nenez9595.blogspot.com/2017/10/aduhai-ustaz.html
Link - https://nenez9595.blogspot.com/2017/10/village-life.html
Link - https://nenez9595.blogspot.com/2017/10/avantages-ofc-budget.html
Link - https://nenez9595.blogspot.com/2017/10/berita-dunia.html
Link - https://nenez9595.blogspot.com/2017/10/terangkap.html
Link - https://nenez9595.blogspot.com/2017/10/budget-day.html
Link - https://nenez9595.blogspot.com/2017/10/visit-rounf-of-visit.html
Link - https://nenez9595.blogspot.com/2017/10/blog-post_25.html
Link - https://nenez9595.blogspot.com/2017/10/faktor-malas.html
Link - https://nenez9595.blogspot.com/2017/10/nilai-merodakkan-perdahabatan.html
Link - https://nenez9595.blogspot.com/2017/10/nilai-murni.html
Link - https://nenez9595.blogspot.com/2017/10/msjalah-mcm-mcm.html
Link - https://nenez9595.blogspot.com/2017/10/politik-sikit2-jah.html
Link - https://nenez9595.blogspot.com/2017/10/politik-masakini.html
Link - https://nenez9595.blogspot.com/2017/10/morning-bteakfast.html
Link - https://nenez9595.blogspot.com/2017/10/morning-dear.html
Link - https://nenez9595.blogspot.com/2017/10/sedop-mendengar.html
Link - https://nenez9595.blogspot.com/2017/10/nak-atau-tidak.html
Link - https://nenez9595.blogspot.com/2017/10/islam-bermusuh-dengan.html
Link - https://nenez9595.blogspot.com/2017/10/penyakit-kririkal.html
Link - https://nenez9595.blogspot.com/2017/10/benda-tu-tepat-brrlaku.html
Link - https://nenez9595.blogspot.com/2017/10/bila-marah-meluap-luap.html
Link - https://nenez9595.blogspot.com/2017/10/badan-penat.html
Link - https://nenez9595.blogspot.com/2017/10/jgn-ikut-aku.html
Link - https://nenez9595.blogspot.com/2017/10/bodoh-or-not.html
Link - https://nenez9595.blogspot.com/2017/10/tukang-tunggu.html
Link - https://nenez9595.blogspot.com/2017/10/mencari-buku-perpustakaan.html
Link - https://nenez9595.blogspot.com/2017/10/blog-post.html
Link - https://nenez9595.blogspot.com/2017/10/2nd-experience.html
Link - https://nenez9595.blogspot.com/2017/07/small-worry.html
Link - https://nenez9595.blogspot.com/2017/07/dua-benda.html
Link - https://nenez9595.blogspot.com/2017/07/sihat-kesihatan.html
Link - https://nenez9595.blogspot.com/2017/07/jaga-diri.html
Link - https://nenez9595.blogspot.com/2017/07/sejarah-membebel.html
Link - https://nenez9595.blogspot.com/2017/07/what-we-learn-from-history.html
Link - https://nenez9595.blogspot.com/2017/07/tawakal-in-english.html
Link - https://nenez9595.blogspot.com/2017/07/banyak-benda-penting.html
Link - https://nenez9595.blogspot.com/2017/07/dekat-1500-tahun-dah.html
Link - https://nenez9595.blogspot.com/2017/07/cerewet.html
Link - https://nenez9595.blogspot.com/2017/07/janji.html
Link - https://nenez9595.blogspot.com/2017/07/kuman-bergelar-boring.html
Link - https://nenez9595.blogspot.com/2017/07/bab-ikhlas.html
Link - https://nenez9595.blogspot.com/2017/07/luka-luka-luka.html
Link - https://nenez9595.blogspot.com/2017/07/adab-ziarah-orang-sakit.html
Link - https://nenez9595.blogspot.com/2017/07/hikmah-wisdom.html
Link - https://nenez9595.blogspot.com/2017/07/kita-tidur-kerana.html
Link - https://nenez9595.blogspot.com/2017/07/dugaan-hidup.html
Link - https://nenez9595.blogspot.com/2017/07/puasa-6.html
Link - https://nenez9595.blogspot.com/2017/07/sakit-pesakit-dan-penyakit.html
Link - https://nenez9595.blogspot.com/2017/07/istighfar.html
Link - https://nenez9595.blogspot.com/2017/07/diet-nak-panjang-umur.html
Link - https://nenez9595.blogspot.com/2017/07/worry.html
Link - https://nenez9595.blogspot.com/2017/07/old-friends.html
Link - https://nenez9595.blogspot.com/2017/07/belajar-bahasa-arab.html
Link - https://nenez9595.blogspot.com/2017/07/kerja-bodoh.html
Link - https://nenez9595.blogspot.com/2017/07/kawan.html
Link - https://nenez9595.blogspot.com/2017/06/beberapa-jenis-nilai.html
Link - https://nenez9595.blogspot.com/2017/06/maruah-diri-dan-bangsa.html
Link - https://nenez9595.blogspot.com/2017/06/raya-ke-lima-di-kelantan.html
Link - https://nenez9595.blogspot.com/2017/06/tak-boleh-lari-dah.html
Link - https://nenez9595.blogspot.com/2017/06/nikmat-sihat-musim-raya.html
Link - https://nenez9595.blogspot.com/2017/06/raya-pertama.html
Link - https://nenez9595.blogspot.com/2017/06/maaf.html
Link - https://nenez9595.blogspot.com/2017/06/kejar-mengejar.html
Link - https://nenez9595.blogspot.com/2017/06/trouble.html
Link - https://nenez9595.blogspot.com/2017/06/bacalah-al-quraan.html
Link - https://nenez9595.blogspot.com/2017/06/rezeki-rezki-rezji.html
Link - https://nenez9595.blogspot.com/2017/06/after-this-what.html
Link - https://nenez9595.blogspot.com/2017/06/sejenak-di-sana-sebagai-pesakit.html
Link - https://nenez9595.blogspot.com/2017/06/fruits-of-labour-pulangan-hasil.html
Link - https://nenez9595.blogspot.com/2017/06/pitih-duit.html
Link - https://nenez9595.blogspot.com/2017/06/doa-aku.html
Link - https://nenez9595.blogspot.com/2017/06/buat-baik.html
Link - https://nenez9595.blogspot.com/2017/06/rehat-relax.html
Link - https://nenez9595.blogspot.com/2017/06/the-best.html
Link - https://nenez9595.blogspot.com/2017/06/nasihat.html
Link - https://nenez9595.blogspot.com/2017/06/feeling-good.html
Link - https://nenez9595.blogspot.com/2017/06/postman.html
Link - https://nenez9595.blogspot.com/2017/06/keadaan-boring-jemu-menjemukan.html
Link - https://nenez9595.blogspot.com/2017/06/berbuka-puasa.html
Link - https://nenez9595.blogspot.com/2017/06/berbagai-bagai-jenis-orang.html
Link - https://nenez9595.blogspot.com/2017/06/si-bonda-antara-dua-zaman.html
Link - https://nenez9595.blogspot.com/2017/06/nasibku-baik-syukurlah.html
Link - https://nenez9595.blogspot.com/2017/06/write-well.html
Link - https://nenez9595.blogspot.com/2017/06/penat-letih.html
Link - https://nenez9595.blogspot.com/2017/06/malam-lai-latul-qadar.html
Link - https://nenez9595.blogspot.com/2017/06/mengapa-terjadi-begini.html
Link - https://nenez9595.blogspot.com/2017/06/eating-well.html
Link - https://nenez9595.blogspot.com/2017/06/reading-al-quraan.html
Link - https://nenez9595.blogspot.com/2017/06/di-mana-kita-buang-masa.html
Link - https://nenez9595.blogspot.com/2017/06/panduan-khatam-al-quraan-bulan-ramadhan.html
Link - https://nenez9595.blogspot.com/2017/06/social-visit-lawatan-sosial.html
Link - https://nenez9595.blogspot.com/2017/06/feeling-perasaan.html
Link - https://nenez9595.blogspot.com/2017/05/sayang.html
Link - https://nenez9595.blogspot.com/2017/05/future.html
Link - https://nenez9595.blogspot.com/2017/05/taking-risk.html
Link - https://nenez9595.blogspot.com/2017/05/tiga-jenis-ubat.html
Link - https://nenez9595.blogspot.com/2017/05/maaf-tegur-sikit-ni.html

Hadeh.. sekali lagi plan aku sangkut dalam percubaan. Aku harap nak plan C ni nak backup, sekali tak boleh pakai plak. Maybe kene buat plan D pulak nih tapi takpe-takpe, kita tunggu hasil dari plan B dlu. Mana tahu ada luck?

Bersambung pada bahagian ke-3 pula. Wassalam ~

update

Update 22/07/2121:

  • Oh nice, add mamat bhai ni forked kod Ruby aku dan fixed kan error tu tu semua.
  • korang boleh check kat forked Github gist ni kalau nak cuba.
  • Padu la korang guna Ruby programming ni ekk..apa benda la korang makan yer

Edit

Discussion and feedback

You can use utterances provided below to post comment on behalf using Github account. Alternatively, you can just send a public comment to my mailing list or send a private message to my e-mail. In a few cases and on certain time, I just don’t have time to moderate them. Please read terms-of-service (ToS) for details.